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I. Summary of Findings >, 

Grade 3 test scores improved in 1981-82 for the 1 5th consecutive year. 
» * 

- Grade 6 scores imprpv.ed for the 5th year. 

» % • « 

Grade I? scores improved in two content areas and decreased slightly in 
two. 

• « 

During the 1981-82 school year, all third, sixth, and twelfth grade stu- 
dents in/California public schools were tested in the basic skills of reading, 
written language, and mathematics. The. following paragraphs provide & brief 
summarV of the main findings. 



Grade Three Results 



Reading test scores' fj>r third grade pupils have been improving steatfHy 
since statewide testing in that grade bejgan in 1967. This tre^id h^s continued 
through 19&1-82. A summary of the test -results is presented in Table 1. The " 
overall gain in 1981-82 was four scaled score points. s ) 

The areas of written language and mathematics have .only been tested 'for 
thre(| years in grade three. The scores this xear were up by five points in 
language and seven points in math. 

Special equating studies were conducted to determine the relationship of 
the current performance of California pupils to fhe performance of a -sample of* 
students across . the Yiatiorf. The median score of third grade pupils in Calif or-i 
nia was determined te^be at the 60th percentile rank ^.n reading, the 56th in^ 
written language, and, the 55th percentile rank in mathematics- 

• — 

Grade Six Results ' k • * * 



All students in grade six took the^ Survey of Basic Skills: Grade 6 , 
another test developed specifically for the California Assessment Program. The 
scores of California sixth grade students improved in all content areas tested: 
reading,* written language, and mathematics (see Table 1). The amount of &ain 
was least in reading (two ^points'), next most jLn language (four), and 
most in mathematics (fiue). ' tt 



Summary of Findings 



Table 1 



Numbers of Students Tested and Averaee T*eit Score by Grade Level 
and Content Area f rom 1979-Sb Thdpugh 1981-82 
California Assessment Projyr^m 



Grade level and 


Average test 


score | 


Dif fererfte 


cogent area 
(number tested) 


1979-80 


1980-81 


1981-82 


1979-80 Co 
. 1980-81 


1980-81 to 
1981-82 . 


Grade 3' (254,232) 
Reading 

Written Language 
Mathematics r 


* — 

250, 
250 ■ 
250 


or/ 

254 
255 
254 


258 

260 « 
261 


+'5 
+4 

* 


* +5 

+ 7 


Grade 6 (293,281) 
Reading 

Written Language 
Mathematics 


250 
■ 250 
250 


252 
, 253 
253 


2fe4 
. 257 
258 

I f 


x +2 
+ 3 , 
+3 


+ 2 
+4 
. ' + 5* 


'Grade 12 (220,603) 
"Reading 

Written Language 
1 Spelling * 
Mathematics » 


,63,1 
62.4 
'68.8 . 
66.8 


63.4 
63.1 
69.0 
68.0 


63 .-2 
63.2 
' 69.5 i 
' 67,7' 


+0.3 
+0.7 . 
, +0.2 
+ 1.2 


-0.2 . 
+0.1 
+0.5 
-0.3 



'••S 



Note: 



ine stuic& i. \j l ^»^^ & - - 1 \ 

units, Thes.e scores, briefly described i<n Chapter II, t^nge frbm 100 to 
400 with a statewide average of 250 in 1980,' the base yecfr^s — llie scores 
for grade twelve continue to represent the percentage of questions 
answered correctly. National comparisons for aU scores are ay^ilable in 
Chapter VI. 

■ . ■ / 

* An eqqa'ting study provided a basis for comparing sixth grade Califorry.a^ 
students with 'a national sample- ^of students tested in 1973. On the basis of 'the- , 
results of the study, the median sixth grade student in California is above the^^ 
national median'in all areas. In'reading the median sixth grader in California 
moved from the 57th to the 58th percentile rank'in 198L-82. The , median student 
moved from the 55th to the 57th" percentile rank in written language and 
increased to the 58t'h in mathematics. « 



Grade- Twe lve Results 



b^e*n 



All students in grade twelve took the sam^test that has be'en 'administered 
since 1975-76--the Sur.vey of Basic Skills: Grade 12 . For the first time, 
scores in 1980-81 were up in all content areas. In 1981-82, the scores went up 
in, two areas and down in two areas. Reading slipped by 0.2" percent^ corrects, and 
math scoreswent down by 0.3 percent correct. Written language and spelling 
iraprbved "byO.l and'-0.5 percent correct, respectively. 



Summary of Findings 

. 1 ; . v . " • . 

t 

, Special equating studies provide a basis fos comparing the performance of 
California twelfth graders with that of national test publishers 1 norm samples 
tested in 1962 and 1970. On the basis of the 1962 norms, the median twelfth 
grade student in California remained in 1981-82 at the 42nd percentile rank in 
reading, the 35th percentile rank in written expression, and the 46th percentile 
rank in mathematics. , \ 

- Comparisons with two other tests with 1970 norms placed California twelfth 
grade students somewhat lower; ^at the 32nd and 35th percentiles irr^ reading, at 
the 29th and 30th percentiles jTowbritten expression, and at the 44th and 47th 
percentiles in mathematics. m * r 

♦On the basis of more recent norms (197^) for these tests, California's 
performance has generally improved relative to the nation. The median Califor- 
nia stucfent is-\iow in the forties (percentile rank) on most of the tests, and 
above the 50th percentile on two of the comparisons. 

\ * : * 

Other Findings 

Chapter VII presents a comparative analysis of the amount of instructional 
time California students receive, relative to several national estimates. The, 
main differences are in the areas of mathematics and science (less for Califor- 
nia students) and are especially strong for college-bound-, students. j 

"Chapter VIII -presents the results of d survey of the availability and use 
of computers in California elementary schools^. 



V 



li. Introduction to the Report 



* Thi^report contains the, complete statewide results of fcife^balifornia 
Assessment Program, including some features that have become standard and some 
that ,are new this year: 

Detailed findings . Information is presented not only for the major content 
areas of reading, written language, and mathematics but also for a variety 
of ^specific 'skill areas within each major area. 

t 

National comparisons . Although the tests were developed to correspond 
specifically to the skills and concept's being taught in California schools, 
special studies have been conducted to show how the performance of Califor- 
nia students compares, to that of samples of students from throughout the 
nation. 

V 

Expert opinions . Recognized authorities in each 'professional field have 
presented their interpretation of the results for each of the content areas 
by identifying skill areas of relatively impressive student performance and 
other skill areas that need attention. t 

/ 

Comparative results . All test results in this report are comparable to 
those of previous years, either because the tests have not been changed or 
where new tests have been introduced the results from the old and new tests 
have been placed on a common scale. , . 

School attitudes *. For several years the statewide advisbry committees 
responsible for developing the- CAP tests^have encouraged the measurement of 
attitudes toward school subjects as well as actual ,ability to perform tfhe 
skills. The report now includes information about third grade stucferits 1 
attitudes toward reading, written language, and mathematics. 

Scholastic Aptitude Test (SAT) scores . Al&ough the Scholastic Aptitude 
Test is not a part of the California Assessment Program, the latest resultg 
'for California's college-bound seniors and their counterparts thrpughout 
the nation are included in this report so they can be compared conveniently 
to the basic skill test results for all California public high school 
seniors. $ 

School Characteristics * The California Assessment Program is mandated to 
provide information about the characteristics of' effective schools and the 
factors related to the quality of their programs. This year's report 
focuses on the issue of time for learning, specifically, how elementary 
schools allocate the available time to different learning areas, and the 
number of courses California high school seniors ? have completed in differ- 
ent subject areas. It also presents information on the availability and 
use of computers in California elementary schools. 
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Development of the California Assessment Program 

The California Assessment Program was first fully implemented in 1974-75. 
In design, development, and procedures, it is unique in the nation. The assess- 
ment program was designed with several criteria in mind: CO it must be rele- 
vant to California schools; (2) it must cover the full range of instructional 
objectives; (3) it must provide program-diagnostic information at local and 
state levels; and (4) it must take only a minimum of testing time. This section 
describes the process of developing such a program. 



Background and Assumptions 

: ' — , * 

The state assessment program had its foundation in two legislative acts: 
(1) the California School Testing Act of 1969, a revision of a 1961 law which 
first required an achievement testing program in the public schools; and (2) the 
Miller-Unruh Basic Reading Act, which originally required reading tests in 
grades one, two, and three. The testing program was revised by 1972 legislation, 
and major changes yere made in, the program as a result of that legislation. 

The changes in the statewide testing program were based on the principle 
that an efficient state testing program has to be limited in scope — that is, 
limited primarily to the task of furnishing useful information to state-level 
policymakers and .decision makers. It was assumed that the program could not 
meet all of the many information needs of local school district personnel and 
that assessment information needed at the classroom level could best be 
collected by local school personnel. t 

In spite of this assumption, the program was designed to report as much 
information as possible to local personnel. Since all students at a grade level 
in all schools were tested, it was possible to provide very detailed analytical 
reports foV: each school to supplement locally obtained information. In fact, 
the results of a survey of all districts in California showed that most dis- 
tricts have found this unique information very useful in evaluating and revising 
programs. Board members and other local citizens have relied heavily upon 
statewide results in making judgments about local needs and accomplishments, 
primarily because of the uniform and comparable nature of the information 
provided. 

Reasons for Revising the Testing PrograriT 

jr 

Two major problems were addressed through the revision of the statewide 
testing program: 

Test relevancy and breadth :, The incomplete match ljejtween the relatively 
narrow range of skills measured by any one published standardized test, on 
the on$ hand, and the variety of instructional programs in California 
schools, on the other, made it difficult tp ajssess the skills of California 
students or the effectiveness of the programs with any degree of; assurance 
of fairness. Furthermore, it was not possible to assess the relative 
' strengths and weaknesses of California students in order to have an 



... • , 
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\. 

indication' of how instructional programs should' be redirected, siace the 
standardized tests being used yielded 'only total scores* ^ 

, ♦ 
Testing time . Previous testing instruments required "an inordinate amounjt 
of student time for the testing process — inordinate, at least, in relation 
to the usefulness of the results? The use of a new testing technique 
"called matrix sampling has noy; reduced the amount of testing time at 
.certain grade levels from as touch as three and one-half hours to 30 
minutes. ^Under this sampling, method, all students at a grade level in all 
schools are tested, but each student takes only a portion of the total 
test. Results for an individual student cannot be obtained, but quite 
accurate estimates of the overall performance of groups of students can be 
computed. * 1 

• *. 

The National Norm Dilemma 



Since 4962, thefirst year of statewide testing in California, all tests 
adopted for use had been commercially published instruments with "national" 
norms. The new tests described in this report were constructed specifically for 
use in California sctfools.- The decision to develop tests rather than use 
commercial "off-the-shelf" tests with national norms was not made casually. 
Comparisons to national averages are not only interesting but are also useful as 
a basis for judging, the ^ overall relative effectiveness of California's instruc- 
tional programs. Furthermore, California Taw (Education Code sections 60663 and 
60640) requires that such information be made available. ' 

A real dilemma, one ,wi*th both philosophical and technical aspects, faces 
anyone who would measure the basic skills of California students? to choose a 
test which has national norms but fails to address all the skills taught in 
California schools, or to develop a relevant test which does not allow easy and 
immediate national comparisons* Assessment programs in other states are about 
equally divided between 'these two approaches. After 11 years of using tests 
with national norms but .less than satisfactory coverage of the skills being 
taught in Calif ornia* schools and after observing the difficulties faced by other 
states in 'interpreting the results from their own tests without national norms, 
the course to be followed was obvious: Develop a test which fits the instruc- 
tional programs of most California schools and then find a way to compare those 
results ta national horms. 

A plan which could accomplish this (allow one tQ^have. ope 's cake and eat 
it, too)* had to overcome two main problems witti the national norms associated, 
with published standardized tests: \ 

l . f . 

1. No^ single test is given to all students in the country. Of necessity, a 
publisher's norm is, therefore , # only an estimate of what the distribution 
of scores would be like if, in fact, the test had be$n taken by all stu- 
1 dents in the United States. For this reason, norms vary from publisher to 
publisher, sometimes in the extreme. In California's own recent history, 
the Stanford Reading Test *?as administered £o all second, grade students in v 
the 1969-70 school year, and the median California studerft scored at the 
38th percentile of that publisher's norms. In the, following year, t t he % 
Cooperative Primary Reading Test was administered <to all second 'gracfe / 

• * r 

' * ">\ 
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students. The median California students scored at the 50th percentile of 
that publisher's norms. The different result was clearly a reflection more 
of the difference in norms than of the difference in reading achievement. 

' * . * < ' ' v < 

2. A second problem with ngrm& is that they are not updated very often. For 
instance, the Cooperative Primary Reading Test „was formed during the . * 
1965-66, school yeajr. As a result, when ^those norms are referred to, it • 
must ^be clearly understood that the comparisons being* made are to the «, 
publisher's estimate of what scores on that test would have been "if admin- 
istered to all students in the country at that time. If reading scores for 
the nation had dropped continuously since 1965-6&, an "average" >score for 
California students might, in fact, reflect achievement far above current 
nationwide averages. . 

• m 

. The resulting plan is straightforward and efficient. It involves the 
equating of the California tests to standardized tests with national norms and 
updating those comparisons as new norms or new tests become available. The 
equating process requires that a sample of students take bot,h the California 
test and one of the other tests. The effect of the statistical analyses follow-* 
ing the testing is to show how California students -would have scored if they had 
all taken the standardized test. Following recent refinements to the equating 
procedures, "a study now has to be conducted only once, but the annual^progfress 
on the California test can be translated into the appropriate national percen- 
tile ranks — against the year in which the publisher's test was normed, of 
course, not against the national performance f<}r that year. The latter would be 
the most useful information, but it is simply not obtainable. 

i % \ . 

„ This solution has several advantages: (1) the national comparisons are 
more timely # since they can be updated as new norms become available; (2) the 
estimates are more stable since they do not depend on the representativeness of 
a single publisher's sample; and (3) it allows California schools to, be assessed 
wJUJ) a test, which, fits the objectives- oL the instructional* program and. simulta~ 
neously, with almost no additional ^testing^, allows that performance to be 
compared to national*norms. , 



, Essential information AbQut the Numbers Used in This Report 

The Percent Correct Score 

A statistic used in this rep6rt to indicate the achievement levels of 
California students is the "average percent Correct score." For a given set of 
test questions, this number is the percentage of correct test responses , with 
one response being equal to the answer of one student to one question, and the* 
totaPrtumber of responses being equal ,to the number of students multiplied by 
the number of items on the test.' For example, if three 4 students took a test 
with ten questions and if each of the three answered five of the ten questions 
correctly* the total number of responses, would be 30, the' total number correct 
would be 15, and the average percent correct score would be 50. It\can also' be 
said that the average student answered 50 petcent of the questions correctly; or 
that£ on the average, 50 percent of the questions were answered correctly. 
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The average percent correct score an5 the simultaneous presentation of 
illustrative test questions or exercises a^re designed to add to the clarity and^ 
us«ulniess of xtfe* findings/ It shoiild be easier, ( as a result, to see w'hat^ 
California students axe^able to do. Unfortunately, this fhetViod is^go^ogw in 
educational evaluettton and assessment that guideline^ and rule-of-tnbmb bench- 
marks^ are not available. Each reader will* have to evaluate the adeqi^^y of the 
results. The emphasis is on establishing realistic and necessary levels of 
actual, competence rather than on the traditional comparing of results to & 
national norm., 

How High I,s High? % 1 ^ 

It^will be noted thatmost of the average percent cortect scores hover 
arSiind the 60s and 70s; however, some are down in the 30s, and some are up in 
the 90s. Two points must be kept in rairta^in interpreting these figures: 

• * # *' 

1. # The raajou^eason that the^average scores are in the 60s and 70s, rather 

-than the 90s, is that the aims of the instructional programs at each level , 
in California schools go beyond the basfc, minimal levels of performance 
expected of all students. In reading, for example, those skills, which are 
mastered by most Students byHthe end of the. third grade are not even tested 
in the sixth grade* Testing time is too valuable and^the scoring and 
processing too expensive to justify gatheriitg information which does hot 
add to what is already known about California students. 



2. It^should be obvious that high^scores in particular skill areas do not 

necessarily indicate effective programs; or tow scores, the opposite. Some 
tasks are inherently more dif^iciilt. In reading, for example, it is not 
consid££ecLouts£attding t ^ at ' by tKk&nd of grade three, nearly all students 
TSrh immediately recognize &nd readXcertain short words; and it is not at, 
all disappointing that only about 67\per'cent can answer certain questions 
requiring a student to recognize cause-and-ef feet relationships among' <I 
sentences. , 

r 

Development of a New RepoYtiftg System 

. » 

The Nfeed . FoV.many years the results of the California Assesment Program 
have been reported in this volume in tjerms of the percent of questions afiswered 
correctly. Sthoolj, district personnel have also received, their local .results in 
thi^V f orra. .Locki results*, of < crux's e, "can t .also be compared to the scores of 
pther sctiools and .districts , .using the per.cenft.le rank tables prepared annually. 

** » 

Although fhe percent correct score has the advantages described in the 
preceding section afld will continue to be the basis for most of the inter- 
pretations and recommendations proposed in this report, they have certain 
disadvantages, some of Which are outlined below: ' \ 

1. When a new test is introduced, as in grade thrfee ln"1979-80, the scores 
* from the new test cannot be compared directly-'io those of the old test, 
the new' test; in grade thtee, for example, is more difficult than the old 
test. A simple comparison of /the scores would makd it appear as if all 
schools had declined, when in reality the average score £pr*1980 went 
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up siightly. 4 Jhe relationship of the scores on both tests must be deter- 
piined through "an "equating- study./ The progress of a sphqol or district 
can then be followed when the" scores for-Joth tests are put on a common 
sckle. , 1 , • * ' J ■ , \ 



2. The percent correct scores do not easily facilitate comparisons across 
content .areas (e.g., reading with\ath) or pcrosS grade levels.^ This is 
not really problem at the state level, since the focus is primarily on 
v the aCtvial .performance of students; i.e^, the proportion of them who can. 
answer given types of questions correctly. .School personnel, however, 
often wish to compare the relative performance of their students -in dif- 
ferent content areas, for example, reading performance with math perform- 
ance. It can be seen that the rationale for and process of developing, the * 
tests militates against^this simple comparison. ~ 

The Calif ornia Assessment Program tests were expressly designed to measure 
the wide array of skills taught in a good instructional' program rather than 
to maka v an easy test by focusing on simple skills or an extremely, difficult 
test by £&ve ring only the complex or advanced Wills. Statewide advisory 
committee's designated the proportion of**the teWto be 'devoted to the * 
various skill a£ea£ on the basis of their importance, rather than their, 
relative easiness or difficulty. Therefore, t#$reUs J*o reason to expect a 
70 p'ercent correct score in reading to 4 be equal to a 70 percent score in* 
math, or a 65 percent correct on the third grade math test to equal a 65 
percent correct on the Sixth grade math test. 

The Solution . , After three years of developmental effort, thfe Department of 
Education has implemented, a scaled score system for reporting the jre&ults of the 
California Assessment Program tests. It was introduced first in 1980 at the 
-third grade level in conjunction with the new Survey of Basic Skills: Grade 3 
and in 4982 at grade, six! The power of this ^w scaled score methodology . is 
best realized witha'test that is specifically designed to capitalize on its* 
strengths^ m 

* i v ' 

The.new scaled scorps range from approximately 100 to 400. However, 
Relatively few of the district-level scores go below l$0 or over 350. This 
particular range of numbers w,as selected to avoid dedimals, negative numbers, 
and confusion with percent cprrect scores and percentile ranks. Otherwise, the 
scale is quite arbitrary; any particular score — for example, a score of 320 — has 
no obvious meaning that would allow an immediate judgment' about a school pro- 
jj^ar. Scores do not indipate the percent qf questions answered correctly or the 
percentage of schools whiph score Higher or lower— although both* of these pieces 
of information can be obtained from tables which are provided to all school 
districts. In fact, it is this detached, objective' quality whith makes these 
scores most valuable. They f are not tied to any particular test in any particu- 
lar year. They are designed to be a baseline measure which can reflect the 
progress of a school or a schodl district r (or^ the state) over a Reriod of 
years — irrespective of changes to thle test or the progress of other schools or 
districts, Unlike.£ercentile ranks, .which are calculated annually, this scale 
has the same meaning in terms of relative achievement each year. ^ A school or 
di$trict can monitor its progress without being affected by the achievement of 
other schools or districts. 



Introduction to ( the Report. 

The achievement for the average -(mean) third grade student and -sixth grade 
student in California has been set to a scaled score of 250 for 1979-80. 
Bearing some similarity to the, more familiar Consumer Price Index, the score of 
250, although arbitrary, becomes a useful point of reference for monitoring 
change* ' $ 

Since the scores for the content areas of reading, language, and mathema- 
tics are all on the same scale, it is possible to compare the performance of a 
school in reading to its performance in math without making any translation into 
normative scores, such &s percentile ranks. 

> 

Furthermore, in comparison to other scores, the units on the scale (100 to 
400) represent more nearly equal intervals. The differences between different 
percentile rank points, for example, are particularly uneven; the distance 
between a school at thfe 50th percentile arid one at the 55th percentile is very 
small in comparison to the distance ^between a school at the 90th percentile and 
*cme*,at w the 95th. These un6v£n intervals make, it very difficult to compare the 
progress of a school at the 5Qth percentile with that r of one at the 90th. Such 
comparisons 1 are greatly facilitated by scaled scores. 

In summary, .the scaled scores now in use in grades three and* six have the 
following characteristics and features: 

Scaled scores range from approximately 100 to 400, with the statewide 

average, student achievement in 1980 set at 250. . 

* * 

- Scores c£n be compared over years, independent of test changes or amount 
of statewide progress. ■ 

Scores can be compared amortg content areas. 

More equal intervals between scaled scores allow better assessment of the 
progress of high or low scoring schools and school districts. 

Scores can be compared directly across grade levels. 1 



III. Reading Achievement for Grades Three, 
Six, and Twefve 



Synopsis of Findings 



Grade thrge reading scores improved for the fifteenth consecutive year; 
gains were shown in all '27 skill areas. • 

A new sixth grade test was administered for the ^first ^tirae in 1981-82. ^ 
Results from an equating study show that gains in sixth grade reading 
were registered for the fifth consecutive year. . 

Twelfth grade reading scores declined slightly (0*2 percent correct) 
from 1980-81 to' 1981-82, continuing a generally downwa^ trend at this 
level since* 1975-76. < 

The median twelfth grade student in California is now scoring at the 
42nd percentile on national norms in reading/ while th'e^median sixth 
grader is at the 58th percentile, ^a-hd the 'median third, grader is at the 
60th percentile (see Chapter VI* "Comparisons with National Norms"). 



Committee Recommendations • 

After reviewing the data presented in the three following sections, the 
Reading Assessment Advisory Committee* offered the following recommendations: • 

!• Parents should help their children discover the enjoyment of reading 
by.: . . * / ^ 'v 

• Reading aloud to them' ■ . - 
o Encouraging ^pleasure reading in the home .« 

o Using television to stimulate reading and discussing the content of 
./ both. 

2. leathers ^should help their students discover the enjoyment of reading 
by: \ f 4 > 

* * • • .* # 

• ^eadirig^ aloud' to them at all grade levels to "immense" them in the 

"sound oi spoken literature 6 « * 

e Setting aside clasjj time for sustained silent reading, during which 
all teachers, acting as role models, read silently along with the 
students - 



* The names of. the advisory c*on\mittee members are listed in* Appendix A. 
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3. Teachers 1 at all levels should strive to foster vocabulary development 
' and higher level thinking skills in all content areas across the 

curriculum . In so doing, teachers should: » • 4 

t Have actual dialogue with students and provide multiple oppor- 
tunities for writing instead of overreliance on assighing and 
correcting workbooks and worksheets. (Research shows that students 
learn more and retain it longer when suph active strategies are 
employed) * 

o Provide ojrportunities for oral language practice through discussions, 
reports, and questionrand-answer sessions that poster students 1 
thinking 

* Require that stttdetlts explain and support their responses iA. order 
to explore and expand tlie thinking strategies students are using \ 

4. Often, the school principal greatly influences the success or failure of 
instructional programs. Every school principal should provide strong 
instructional leadership ahd staff, development activities by: 

Stimulating the teaching of comprehension, thinking," and, writing 
skills in all disciplines across the curriculum 

* .Encouraging teachers and parents to pursue the activities suggested 
iii recommendations 1, 2, and 3 above • i; J 

* Annually sharing CAP rfesults and Resources with all .teachers and 
leading them in a thoughtful review of curriculum ^ t • 



- < 



5. District program leaders should: * - ; • M ■ ( - 4 '^}x 

- lj * - - . -^v ( ( ' 

a Set objectives and use materials .that "are likely to stimulate the 
highest Revels of creative thinking through involvement of students' 
in application, analysis, synthesis, and evaluation* . , 9 

■ f ' ' j" 

1 • Seek w^ys to stimulate raor6 effective teaching and learning in the 
content areas aH: the secondary level (such as identifying strong 
teaching models \t the school site)* , 

I f \ 

6. The Department of Education and Sfate Board of Education should cori^der 

changing, the current twelfth grade assessment to an earlier level, such 

ad the end of the eleventh grade, tcMessen problems of student raotiva- 

• tion and to allow time for corrective action if there- ate skill deficits. 
* 1 t . ♦ 
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Reading Results, Grade Three 



Test Scope And Foundations . ' 

The reading section of the Survey of Basic Skills; Grade .3 contains 27Q 
questions covering five broad. skill areas: (1) word identification; (2) 
vocabulary; (3) literal comprehension; (4) infereijtial comprehension; and (5) 
study-locational skills. These skill areas reflect the emphases. in the Reading 
Framework for California Public Sctioiols: Kindergarten Through Grade Twelve , 
(Sacramento: California State Department of Education, 1980), the county super- 
intendents 1 * courses of study, and state-adopted reading textbooks commonly used 
at the third grade level. 

1 Decisions about the relative emphasis and breadth of content for each of 
these skill afeab were made by the Reading Assessment Advisory Committee, a \ 
group of reading specialists representing a cross section of geographical 
regions, institutions, instruct: ional levels, and. professional groups throughout 
California (list^ecj in Appendix, A). In making' these decisions, the committee 
^members cbnsidered' information from broad field reviews of preliminary test 
content specifications. The .results indicated thl degree Qf eraphasifc placed on, 
each skill area and whether or not the skill should be assessed on the Survey. 
These field reviews reflected district, school, and teacher points of view. 

After careful consideration of ^ the 'reading f raj^fework r and field review " . 
information, the' reading committee decided that the area of comprehension should 
^receive the greatest emphasis on the reading sett ion y£ the JSurvey . .This 
.decision was also consistent with the -state-adopted Handboolc^f or; Planning an t 
Effective Reading Program (Sacramento:" '^Caliifortiia State Department of Educa- . 
tion, 1979), whidh includes, the following statement: "fomprehensj.on is the, 
central goal gf ^ reading" (page 7).* Thus, most ,-of -the reading "questions are, 
^ ^ .cours^, the vocabulary , 

' • items* involve ^comprehension, as well. All the reading questions 9> except the, 
Study-locationaJL items, are basfed on reading selections ^o/that pupils are 
-never asked to deal with reading skills apart from the context of a passage. 

The relative degree ^>f emphasis assigned t6 each of the reading skill areas' 
In ,the Survey is preheated graphically in Figure U, For^a^iliust rated descrip- ' 
tion 'of b^I reading/skill areas a^id underlying; rationale, see Survey of Basic 
Skills: Grade 3, Rational* and Content (Sacramento: talifoxnia State Department 
of Education, 1980). ~~ ' - * 
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Reading Results, Grade -Three 
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Reading "between 
the lines 
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Reading oh j 
the lines / 
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- Fift. I.flumber o* cjuestion,, by skill area, in the reading portion of the Survey of Basic Skills: Grade 3 / 
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Reading Results for Grade- Three ' 

. m gutfyeyoj Basic Skills t Grade $ was. administered for the third succes- 
sive year in ffii=W. The results ot thir d grade performance on the reading, 
section of this test" are shown in" Table*2. Year.-to-.year changes in overall 
perfomahce and. ir, -skill area performance are also sjjwn^the table and ■ 
illustrated graphically (major skill areas only) in Figure 2, 
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heading' Results, .Gr$de Three 

• ' ■ * . Table 2 ' ' > 

Reading Scores of California Third-Grade Students! arid Change in Mean 
Scores on the Survey of Basic Skills: ' Grade 3 , 1979-8$ Through 1981-82 
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Reading Results, Gtade Three 
Study-locational 



Phonics 3 



Structural analysis 



Reading, total 1 

Inferential comprehension < 
Literal comprehension 4 

• Vocabulary « 



-4- 



1979-80 



1980-81 



Fig. 2. Percent correct scores of California third grade students for the major skill areas in reading, 

• 1979-80 through 1981-82 

The following observations are evident from. 'the da ta- in Table 2:. 

• The total reading score for California f s third grade students improved 
0.*9 percent correct from the spring, C8T1981 to the "spring of;^82, 
£ yielding an overall .gain of 1\5 percent correct from the spjhbg/r*' 
' -when the test was first administered* ,\ 1 / "T\ ' 

The largest gains in percent correct from 1981 to 1582 we 
for the following skills: /~*\ 

. ■ Structural analysis v $ 

Prefixes, suffixes., roots % 
* : % " ¥ \ Contractions and compound words ? \ 

• ; Vocabulary * / | 

■.<* , Recognizing word meanings . u 

; Using context with multiple-meaning words 
-.'.•* • * • ** 5 

• Main ideas 
Drawing conclusions about characters 




Table of contents 



+1.2 
+1.1 

+1.3 



% - - , 

The smallest gains, in perc^rtfT correct from 1981 to 1982 were registered 
for the two following skills: < 



^Reading Results, Grade Three f ^\ 



& \ J 

Drawing conclusions from details 40H-^ V> 
J* - - - Drawing, canclus ions JteonL jDxexall meaning +0*2 

• The largest gains in percen^ correct* over the two-year period from 1980 
. to 1982 were registered £or**flie -f oil owing skill areas and skills: 

* ♦ 

Structural analysis % +2.0 

• * .Prefixes, stdEfixes, roots *• +2.0 
; . ' • , • , 

" Table of contents ,\,t t 2#1 . 

• -The smallest gain in percent correct from 1980 to 1982 was registered 
for drawing conclusions from details (+0^-rf^rcent correct). 

o Of the major reading skills tested, th| study-\ocational skilf area was 
the easiest cluster of items (87*8 pefcent Aqrrect), followed by' phonics 
(80.3 percent correct), and structural* anal ys$s (76.2 percent correct). 
Vocabulary (64.0), literal comprehension (6d/4), and inferential c'ompre- 
'hensipn (67.5) were the most difficult ortidcf skill areas for thirds 
graders • ' " * , "* " " , . ' " 

> \ * ~ ' > - ■ • ' " ' 

/ jo At the subskill level, the easies£ area was. the cluster of 1 questions 
y*J\ / pertainidg to using a table of contents (9T.6), while drawing c6nfclusions 
from details {57.0) was, most difficult foi^third .graders (replacing 
vocabulary-uSing context as; the most, difficult area for third graders oh 
the rea&ing. part ion of the Survey). . ' >v , 



^ liiterpretatipn, of Skill Area Results, Grade Three " „ 

~ ^__The mem a .panel ,q£. distin- 

guished California eduoatops with', recognized Expertise in reading instruction, 
and assessment, analyzed, interpreted, adfi jeva^uated the 1 1981-82 reading results' 
j: or grade three., lathis process, they examined thia changes in skill area 
perforpiance in lJ,ght*of the ^philosophy* underlying the CAP reading tests. This ' 
^ philosophy is stated generally in the Reading Framework for California Public 
' ^Schools and more specifically itf Survey of Basic Skills: Gradd 3, Rationale and 

Wjfoutent. 4 " \ f • < . , . ' 

\ *^ ■"* ^ ,'*".*'. 

Because the prbad a?ea of comprehension is judged by the ^cOnttnittee. members 
t9 be the skill srcea of greatest- .educational .and social significance, the 
f ollgspLng discussion- focuses upon thfe r two detfels of comprehension assessed on 
the iSutvey of Basic Skills: Grade 3 and identified iii the Reading Framework for 
■ Calif otnia Public Schools : (1) "Reading on the fines;*' and (2) "Reading betwee'n 
the iines^"- ! _ . • v . 4 1 , w J * . 



Reading on the lines 



"Reading on the*lines M refers to the most basic level* of comprehension and 
* involves, questions that, require ^students to.resppnd to information explicitly . 
stated in the text. These skills, a§ they are assessed on the Survey of Basic 
Skills: Grade 3 », are briefly desdribed .and illustrated below. 



Reading Results; Grade Three 




Illustrative items 



Vocabulary items assess th^ ability to 
identify synonyms, antonyms, and defi- 
nitions 'of words used in a reading 
passage, and the ability to use the 
context of the passage to identify the 
meaning of a multiple meaning word 
(for example, "saw," "run," and "bark"). 

Literal comprehension items assess the 
ability to- answer literal* questions 
including sequence, details (explicitly 
derived from, one, tw<?v or three sen- 
tences in the *eadi % ng passage), and 
pronoun references (jiftfNfc is a boy. He 
is a good reader. .>sa Question: Who is 
a good reader? Answerback) . 



The timer is midnight. ' The full moon is high in^the 
sky. Here and ,tttSFS"*a bonfire lights the beach. People 
.are gathered around the fires, waiting. Suddenly, the 
beach is aliv^ with thousands of \ wiggling fish fas wave* 
after wave carries them to shore. At once the people 
are splashing through the waves, snatching up the fish. 
' Does it sound* like a wild, story? It is not jjist a' 
story. It is a grunion run, and it happens^several 
times every yeatj in southern California. 

The grunion ik a small, silvery fish that is between 

-f ive -and -six r incftes*long. The season fo^laying ^eggs- , . 

i4from the Aiddfe of February to early September. 

.During those months, on the nights of the ; highest tide, 

the grunion swim shore to lay their e^gs in the sand*' 

The next high tid^uncovers the eggs. The baby grupion 

burst out like popborn and ride the wav£s to s€»a. 

# *■ * 

The opposite of high is \ 

- or small. »• 
"6 alive. * ( 

O lOW* S 

o tall. I 



Where were the peopie waiting? 

o in a/ boat 

o hear a hotise 

o - under°a tent , 

o* on the beach * 
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Reading Results", Grade Three 



The scores fox vocabulary afid literal comprehension are shown in Figure 3 
with percent correct scores for 1981-82 and their cumulative percent correct '' 
gains from 1980-81 to 1,981-82. * ' * , 



Percent correct 

; ' score. 1981-82 

Reading (total) • * 71.5 

Vocabulary 64.0 t 

i Recognizing word meanings 1 70.1 

Using context • 57.1 4 

Literal comprehension '66,4 »L 

Details ' » 64.6 

from a single sentence 64.9 

" from two or three sentences 64,3 

Pronoun references 72.0 

Sequence - . 64.6 

■ Percent correct score. 1979-80 , 
°D Percent correct score. 1981-82 



Total change. 
1979-80 to 1981-82 




65 

Percent correct 



Fig. 3. Percent correct scores and cumulative gair>s of California third grade students for the reading skill 
areas of vocabulary and literal comprehension . ■ 



siott skills. They, par 
which had shown only 
committee members obs 
words continues to., p 
this skill, which, pas 




Th4 members*of the Reading Assessment Advisory Committee were extremely 
pleased with the consisteyrt gains^ shown on all vocabulary and, literal comptehpn- 

larly noted the substantial increases in Vocabulary, 
slight gains the previous yehr (see Table 2). The 
ed that the use of context in defining multiple-meaning 
ent considerable difficulty to third graders; hOwevtfc, 
the most, difficult area on'the third grade' reading test 
in previous years, 'is presently the second most difficult skill area. The same 
kind of dontext mfestions appear on the Survey of Basic Skills:, Grade 6 ,' 
yet sixth graders apparently -handle them with ease, since percent Correct scores 
$^:e quite high At that level. It is reasonable to conclude that subsequent 
instruction, experience, and/or maturation during grades four, five, and six 
serve to overcome students 1 apparent weakness in.using context in grade three., 

While>the members of the committee were pleased to see progress in third 
grade, stucfents 1 ability to use context, they concluded that more instructional 
emphasis /is needed in the overall area of .vocabulary, given the central tfSle 
that kncwledge of word meanings plays, in comprehension. 



Reading Results, Gtade Three 



Reading between the lines. 

"Reading between the lines" refers^gjthe higher-level thinking skills 
are employed when comprehension extends beyond the literal message of the . 
written material., Students must respond with ideas or opinions that are .base 
on the material read, but that are not stated explicitly in the material. The 
skills, as they are assessed on the Survey of Basic Skills: Gra^e 3 , are, 
briefly described and illustrated below. , 
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Inferential comprehension .items assess 
the ability to identify the main j.Sea 
of a story, infer a cause-and-ef f ect 
relationship, and draw conclusions , 
from details, from overall meaning," 
and about characters. f 



illustrative item 



The time is midnight. The full moon is high, in 
the sky. Here and there a bonfire lights the beach. 
People are. gathered around the fires, waiting*** 
Suddenly, the beach is alive with thousands of 
wiggling fish as wave after wave carries them to # 
shore. -At once the ♦ people are splashing through 
the waves, snatching up the fish. 

Does it sound like a wild stojr&? It is pot just 
a story.', It is a grunion run, ajif*\it happens 
several times every year in southfitn daJ$i£or»nigy — 
J?he grunion, i,^ a^small, silvery fish -that is 

"tee6we^g^Hve*arid s'ix inches long. The season for 
laying eggs is from the middle of February to early 

■ September , « During those months, on the nights of 
the highest tide, the grunion swim to shore to lay 
their eggs in the Sand. The next high; tid^&nco^ers 
the>eggs. The baby grunion hu'rs#t out like popcorft 
and ride the waves to Sea. ■ 



You can tell from the story that bab^ 
grunion probabjly 

o will die in very deep water, 

o ne6d to b6 taught to swim* 

o will lay "five or six eggs, 

o can stay alive in deep water. 
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. v , Reading Results, Grade Three ■ ^ 

The scares for inferential comprehension are shown in Figure 4 below with 
percent correct scores for 1981-82 and' cumulative percent correct gains from 
1979-80 to 1981-82. 



Retting (total) 

Inferential comprehension 

Main, idea 
.'.Cause and effect * 
Drawing conclusions 

about characters 
. fro'm details * 
frgrjM>verall meaning 



r percent correct 
r f*ffi\ 1981-82 

71.5 1 



67.5 
71.3 
67.f 
65.4 
72.1 ' 
57,0 
65.4 



Total change, 
1979-80 to 1981-82 




m Percent correct $cor$. 1979-80 
O* Percent correct score, 1981-82 

. * ' '-. . •' 

Fig. 4 . Percent correct scores and cumulative gains of California third grade students for the reading skill 
area of inferential comprehension , , , , 



-Percent correct &core 



The members of the .Reading Assessment Advisory Committee applauded the 
schools for. the consistent increases shown in the skill, areas of inferential 
comprehension^ which retire students, in effect, to read "between the lines.** 
Research has 1 shown ,t\iat suGh reading/thinking skills can b£* taught if teachers 

.choose ' to address them and know how to phjra^e questions that require student^ to 
think and imagine,* The. comndttee memherslj^ drawing 

-conclusions abotffc^char alters are the two Skill areas that have regis ft^ch-bhe*- 
largest total, increases over^tfie past tt^o years. This ^pay. reflect the current 
emphasis, in, reading, instruction in the primary grades. The' "reading skill area 
showing the least positive gain was. drawing conclusions from^details, which has 

^ shown .up as a consistent, weakness at' all grade levels in previous years. The * 
difficulty in this area is not surprising since such questions involve multiple- 
step processes, including reading carefully for details and drawing* a conclusion 
fxom the. appropriate detail. Th£ members of the committee recommended still 
moye* emphasis on higher-level thinking skills-rmain Idea,, cause, arid effect, 

\drawing conclusions from details,, and other inferential comprehension skills — 
especially in" view of the still higher g^ins registered in the easier, -more 
basic skills such as structural analysis. „ * 

The members of th,e Reading Assessment Advisory' Committee concluded their 
analysis of gtade three test result^ by of fering,four instructional recommenda- 
tions,, which are presented -below. * , . 



c # Reading Results, 4 <?rade Three . 



READING 'ASSESSMENT -ADVISORY €OMMITTEE , & 
■ INSTRUCTIONAL RECOMMENDATIONS FOR GRADE 3 



1. Research shows that students- learn more and' retain it longer 
When they have actual dialogue with the teacher and have 
multiple opportunities to wirite* Such active teaching stra-. 
tegies should be employed much more heavily and frequently 
fetxan assigning and correcting worksheets and workbooks. 

! » 

(2. Comprehension, especially the higher-level thinking skills, 
and "not mechanics of Wgrd, identification should be 
emphasized In the primary grades. * . . / 

if \ 

3. Every classroom should includ^ numerous opportunities for . ^ 
df4l language practice through* discussions, reporting, and 
question-andranswer Sessions. 

4.. 'Teachers should explore the reasons that students make 

mistakes ,in an attempt to discover the thinking strategies 1 
students- are using. 

: r. — * " 



Reading . Results , Grade. 4 Six . ' 

Test Scope and Foundations ^ , - 

Id 1981-82 a new sixtti grade' test, the Survey of Basic Skills: Grade, 6» 
was administered for the first time. ' • . 

The reading section of the Survey of Basic Skills: Grade 6- r contairfs 
<m questions from, six broad skiil areas: (Jl) vocabulary; (2) literal comprehension 
(3) inferential comprehension* (4) interpretive comprehension; (5) critical/ 
applicative comprehension; and (6) study-locational skills. These skill areas 
. teflect the emphases i t n t\te Reading Framework for" California Public Schools , 
Handbook for Planning an Effective Reading Program , and state-adopted reading v 
textbooks commonly used at the sixth grade level. \ 

♦ Decisions about the ^relative emphasis and breadth of 1 content for each of 
% these skill areas wer<e made by„ the Reading .Assessment Advisory Committee, a 
$group of reading specialist^^representing a, cStoss section of geographical 
regions, educational Institutions, instructional levels, and professional jjroiips 
throughout California. In making these depis^ons, the committee members. consid- 
ered information from field "reviews of preliminary test 'content specifications. 
The results indicated the degree of emphasis pl#£ed on each skill area and 
whether or not the skill Should be assessed on the Survey . Thefee field reviews 
\i reflected district, s.chodl,* and teacher points of view. * 
} ' VS • % ; • ' * L . 

After, qareful consideration of the reading framework and' field review infor- 
mation, the reading committee decided that the area of comprehension should" 
receive the greatest emphasis in the reading section of the Survey . This 
/ decision was also consistent with the state-adopted Handbook for Planning an 
Effective Reading Program , which includes the following statement: "Comprehen- 
sion is the central goal of reading" (page 7). Thus, approximately 75 percent 
~~-_4>E_the heading J4uestiojis_ar£ xompxefienaioa Jttema.., „ „ '1 - . f . „ . 

' ... The major features of the reading section of the gurvey of Basic Skills-:, 
, <?rade 6 are ^highlighted below: % " 




) 



# The new reading test reflects the new Reading Framework for .Calif brnia 
Public Schools , which, emphasizes fcomprehension development, higher-level 
thinking^ reading in the content areas, and promotion of positive* . 
attitudes toward reading in order to establish" a lifelong desire to 
.read. , 



5 ' 



Cpntent .area reporting is a new feature of the ( revised Survey* t Compre- 
hension and vocabjjlary scores are reported for science, social r studies* 
arid literature, ' * l( f « 



.1 - 



The relative degree of emphasis assigned to each of the reading skill areas 
in the Survey is presented graphically in Figure 5. Fo'^ati illustrated descrip- 
tion of all reading skill areas and underlying rationale, see Survey, of Basic 
Skills: ..Grade 6, Rationale and Contend (Sacramento: California State Department 
of Education-, 1982). . ' . ■ / 
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Reading on the 
lines 




Critical/ applicative 
comprehension . / 

Reading beyoftd\ < 6 ? itcms) 
the lines 



^^Reading between 
** ' the lines 



Fig* 5. Number of questions, by skill area. In the reading portion of the Syrvty ofB^sic Skitts Gr»d$ 6 
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Reading Results t f6f Grade Six 

. ; - i ~ < \ > • 

The Survey of Baste Skills: Grade 6, was administered for the first time in 
1981-82. The results of sixth graders 1 performanc^ on the tea&Eng^ section of * 
this test^tre shown in Table 3* * 



ERIC 



26 



2 j ' •• 



. < 



heading Results, Grade Six 



►Student Achievement in California Schools 0 



Table 3 



* • 



Reading Scores of 'California Sixth Grade Students on 
the Survey of Basic Skills; Grade 6» 1981-82 



Skill area 



READING, TOTAL V - J 

* 

Vocabulary 

Prefixes, roots, and suffixes 
Recognizing word meanings r 
Using context with multiple-meaning^ words - 

Comprehension « 
Litetal 

.Details . 
— frota single sentence 
t — from two or three sentences 
Pronoun references 

SequBtlce ( . f 

' Inferential t * 
Main idea - 

Cause and ^effect _ f \ L ' . 

FollbW±ng -organisation ' ^ 

Putting information together < ■ " 

Predicting outcomes 

Making comparisons and contrasts . •« 
s Drawing conclusions from details , . 

Drawing conclusions from overall meaning 
• . *. * 

Interpretive 

Analyzing/characters - 

Undestanding setting 
- Sumitorizing plot 

Understanding' dialogue 

Sending mood r , 

Understanding figurative language. 



Number of 
questions 



Mean score 



r 



430 

70 . 
16 
• 37 
17 

330 
62 
31 ' 
14 
17 
16 
15 

' 127 
* 16 

to 
' is 

17 
16 
14 

79 
18 

. 12 

12 

■ .12 . 
- 12 



71.5 



70.1 

P.O. 
67. 7 

.78, 1, 



71. Z 
76.7 
8QS1 
80.2 
80.0 
74.3 
72.4 

67.3, 
U 
75.6 
58.0. 
62.5- 

69; 3 
60*. 6 
65.1 
75^.3 

75.6 
78.4 
73.4 
,77.2' 
67. i 
7.7.4 



• Reading -Results, Grladfc Six ^ * 

Table -3 (cbnt./ ' v *' ' • ' "• 





•Number of 




Skill area ' • 


questions 


Mean score 


Critical/applicative 1 comprehension 4 ' *• 
, Detecting author and'*authar f s attitude* 


62 


68.7 


> 12 


66.1 


Detecting author's purpose 




72, 7 


Separating fact from opinion 7 


' 16 


66.8 


Applications to a different' context 


'15' 


.67.9 


Study-Locational skills 


. 30 


, 77.4 


• Reference* materials and parts of ai book . 


.15 


§1.8 


Maps, graphs, and charts . ' ■ 


15 v 


73.1 


Reading in the .content areas , . 






' Vocabulary— Word meanings , ' *• 


37 ' 


67.7 


In reading and literature / - 


13 


71.2 


In science ' * 


11 , 


71.1 


In social studies *, 


.13 


6U3 


Comprehension of literature passages 


' 117 . 


74.3 


Literal f 


17 


79.5 


Inferential 


. 29 


72.0 


Interpretive , * 


61 


• 74.7 


Critical/applicative 


10 


: « 69.9 . * 


Comprehension of science passages 


103 


68.0 . 


Literal 


.17 ... 


76.5 


Inferential. A * - . - 

Critical/applicative ■ - 

• " ? 


58: 


65.4 


. 28 


68.4 


Comprehension of social studies passages 


107 , 


70.8 


Literal 


.28 


75.2' 


Inferential 

Interpretive * 


40 


66.7 


15 


77.0 


' Critical/applicative 


24 


• 68.7 



• • . . . . '" > \ 
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... Study-locational- 
\ Literal comprehension- 

Interpretive comprehension. 

► * ,< 

Total rending | 

» i 
( * ( 

v». ;* Total comprehension - 

t 

Vocabulary ■ 



~> Critical/ applicative comprehension — 



Inferential comprehension ^- 



57 



67 77 

Percent correct score 



87 



Fig 6 Percent correct scores of California sixth grade students for the majorskill areas in reading, 
1981*02 * 



.at 



ifoe following observations are evident fi*bm the. data in Table 3* 

• The highest scdre was registered for using reference materials and parts 
of a book (81.8 percent "correct) followed' by details from a single 

9 sentence ( 80,2 percent correct), and details from tWo or three sentences 
(80*0 percent .correct*) *• \ . . 

• Tlie lowest score was registered for following organization (58.0 

, percent correct), which substcill under inferential pomprehensioh. 

• In reading in the content areas, the highest scorfe was registered for 
cortprehenki-on "of .literature passages (7,4.3 percent correct), while the * 
lowest score was registered fdr "comprehension of science passages (68.0 

y percent correct). ' 
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ItfterPTetal^ion of Skill Area Results^ Crade Sfx " 

The members' of the Reading Assessment Advisory Committee, a panel 9f 
distinguished California educators' with recognized expertise in reading instruc- 
tion an<J assessment, analyzed,, interpreted", and evaluated the 1981-82 reading 
results for grade six. ' In this, process, they examined the scores in the reading 
skill areas in light of the philosophy underlying the CAP reading teste. This 
philosophy is stated generally in the Reading Framework for California Public 
Schools and more specifically in Survey of Basi<r Skills: Grade 6, Rationale and 
C ontent. In accordance w£th the Reading Framework , the committee's analysis of 
the results focused on ttie following broad categories: "Reading^on the lines," 
*Readihg<vbetween the lines," "Reading beyond the lines," and "Reading in the 
content ajj^as^" 

" ' • y y ; * v 

Reading on the lines... . r . •» 

... - h 
-Reading on the lines" refers to the most fundamental lfevel of comprehension 
and involves questions that require students to respond to informatibn explicitly 
stated in the text. These* skills, as they .are assessed on the Survey of Basic 
Skills: Grade. 6,) include vocabulary and literal comprehension, which are 
described and illustrated below;? ** } K * 4 , 



Readme on the 




• Vocabulary items assess the ability to 
identify meanings of wofds used in a h 
passage* Test words cover core science 

■ and sjocial studies, as well as general 
vocabulary. Vocabulary items also, r "' 
, . assess understanding of .common roo£s^_ 
. prefixes and suffixes, and the ability 
t6 use the context of the passage to 
identify the meaning of a multiple- 
uneaning wbrd (for^example, "saw," 
. "run, "-and "bark* 1 ?: . ' . 

• Liberal comprehension items ass.ess' the 
ability to answer literal questions , 
including sequence , details (explicitly 
derived from, one, two, , or tliree sen- 1 

. tences in the reading passage), and 
pronoun references (Jack is >a. boy. He 
is a good reader/ . .Question: Who- ;Ls 

• a good reader? Answer: Jack). 
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Sample .items from illustrative* science passage 



4 * 



— ^ 



Same kinds of fish needrto i>e cleaned of the parasites, 
that feed on them.' , If the parasites staylpn the f>£h, 
'sores can form* ' \ . X^^^ 

. In the Pacific Ocean are small cleaner fish called 
wrasses* The ^wrasses get their food^ by removing para- 
site6 from the head and gills of other ^fish. Many large 
and dangerous fish come to them to be cl^aneQ. 

* , To get customers, $ wresse usually sets -up business 
near a busy spot. Its cleaning station may be a 'rock or 
patch of white sand.. When another* fish swims near the 
station, the wrasse does a kftid of dance to catch the; 

.fi&h's attention* If the £ish wants to' be* cleaned, it 
ho^ds quite still. « : 

',». Sometimes a^ISJge group -of fish wait to be cleaned at 
'a** wrasse's cleaning station* . In the group are many 
different kind3 v -of fish, such as jacks, parrotfi^h, eels, 
~bks$, or sunfish. ; , . ' p A r 

*- A wrasse uses»its teeth and jaws to remove the para- 
sites from the customer's body* The wrasse may want to 
clean under the customer's fin* It gives the other fish , 
a gentle push and the customer lifts its fin. If the 1 
wrasse wants the' customer to 'open its mouth, it 'pokes 
between the fish' t £ tefeth and lips.. 



In this passage £ parasites means > 

o" friends who stop to chat. 

o many different kincte of . fish. 

o fish that eab smaller, fish. 

o animals that 'live on another animal. 

Where are the small cleaner fish? 

o in the. Atlantic Ocean 

o ih rivers and* streams- - 1 ' 

o' inl^kes and ponds <® 

o/ 1ft the Pacific Ocean. , . 
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The percent correct spores for vocabulary and literal comprehension are 
shown numerically and graphically: in Figure 7« 



Reading (total) 

Vocabulary* " 
Prefixes, roots, and suffixes 
Recognizing word meanings 
Using context with multiple-meaning words 



Literal comprehension 
Details * - 

from single sentence 
from two or three sentences 
. Pronoun references 
Sequence 



/ 



Percent 
correct 
score 

71.5 
70>! 
67.0 
67.7 
78.1 

76.7 
80. t 
80.2 
80.0 
74.3 
72.4 



67 77 

Percent correct score 



87 



Fig. 7. Percent correct scores of California sixth grade students for the reading skill areas of vocabulary ", 
and literal comprehension, 1981-82 •* 



The members of the Reading Assessment. Advisory Committee were -pleased to . 
see the generally high scores for vocabulary (70.1) and literal comprehension 
(76.7). They noted that the scores for all literals comprehension skills were 
higher than the total reading score of 71.5. Some committee members commented . 
that. 'the display of strength shown in literal comprehension clearly reflects the 
continued emphasis of . elementary classroom instruction on literal-level responses 
' i . . 

' The /committee members were- equally pleased to observe the relatively high- 
score (78.1, p'ercent correct) for, the questions on use of context; These 5 items 
require students to use the context of written material to identify, the meaning 
of a common multiple-meaning word' (such as "fall" or "pen".) The metfbers of the 
committee were. gratif iecNto see that this type of question, which caused consid- 
erable difficulty for third- graders, has become a relative strength for sixth 

" graders. This Improvement from grade three to grade six is apparently the 
result of strong instructional efforts W/.6r conceptual gains in literal and 

- contextual comprehension in the intermediate grades'. However, the committee 
members also noted the lower scores in the other two vocabulary skills: prefixes 
. roots, and suffixes (67.0) and recognizing word meanings (67,7). These clusters 
of • questions* require knowledge of vocabulary above and beyohd what can be 

.'determined, through the use of context. The items in the recognizing word 
meanings category are composed.~o| common words' from the basic curriculum areas 
of literature, science, and social studies. Because vocabulary knowledge is so 

• crucial' to comprehension across' the .curriculum, the members of the committee 

.' concluded ,that more emphasis is needed on vocabulary development through oral 
. language activities, broad and varied reading, and direct instruction.^. • 
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Reading between-.the lines. * 

' * - ,* * *** - 1- . - , » 

"Reading between the lines" refers to the higher-ifevel thinking skills that 
students must use^ to respond witl\ ideas pr opinions that are based on the 
material *ead but that are .not stated explicitly in the material. These skills, 
as they are assessed on the Survey of Basic Skills; drade 6 , include inferential, 
and interpretive comprehension skills, which are described and illustrated 
below. % * ' . ' V 




Reading between 
the lines 



Inferential comprehension items assess 
the ability to identify main ideas, * 
infer cause and effect relationships, 
follow the organization of a passage 
'by supplying missing points of. an out- 
line, putting information together 
from different parts of a passage. 
Predicting logical outcomes, making . 
comparisons and contrasts, drawing 
conclusions from details, and drawing 
conclusions from overall meaning. 

Interpretive comprehension items apply 
primarily to the literature passages 
as they assess the ability to analyze 
characters, infer setting, summarize 
plot, interpret dijalogue, sense mood, 
and understand figurative language. 



T>t Sample items from an illustrative story 



* The beasts arid birds of the dark woods were gathered around an old boot. 
They' had .come to find out what it was. , » 4 

"There is no-<Joubt about it," said the lion, pointing to the outside. 
"It is the .Shell of some kind of ' nut. " ' 

"Not at all," replied the wolf >. putting his paw inside*- "It is a nest.. 
Here is a deep hole for-fche bird, to go in and, be safe with her' eggs and yojung 
ones - . r ; ^ . . . , 0 + ' , 

* \No, , sai^d the*bear, holding up a lace. "This is the long root of some 

• plaftt."^ * * *; v ' • , * • 

"I can tell you what Sr is, ", hooted the Wise old owl from a nearby tree. 
."It. is a man's boo£." * ♦ 

"What is a man? 1 ' cried the beasts. and birds. "What is a boot?" 

"A man," said'tbe 6wl, "is a thing with two legs wfco can niake himself go 
faster than we* can, and^hei can fiy without wings." 

"That can't be true," said the beasts. "How can anything, with two legs 
go faster than we <:an with four?". % s % ' 

a "It can f t b& tfueT ^othing* without wings can fly," the birds added angrily., 

"Well," the owl continued, "they make things like this and put th?m on 
'their- fe'et." ' * 1*. h ' ' • - 
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"Shame, shame," 'cried all the beasts and birds,. "No one wears things on 

him come 



their feet. It's not true. You are not fit to live with us. 1 



back. 



So they chased the poor old owl out of the woods an<3 ne?ver let 

One conclusion to be drawn from this 
'story is that 

o the lion is, truly the "King of the . ^ 

Jungle." * > 

o new ideas are not easily accepted, 
o flying is not; possible without wings, 
o truth is always quickly recognised. ( 

The beasts and birds can best be described as 

o proud and closed-minded. . , 

o under standing and wise, 

o sleepy and iazy. 

o thrifty ancl Jiard-working- 



The percent correct scores for inferential and interpretive' comprehension 



are shown numerically and graphically in Figure 8. 



beading (total) 

Inferential comprehension 

Main idea \ - 
— GausC and effect — — - - • 
Following organization 
Putting information together 
Predicting outcomes 
' Making comparisons and contrasts 
Drawing conclusions from details 

■ Drawing conclusions from overall meaning 

Interpretive comprehension 
Analyzing characters 
Understanding setting 
Summarizing plot , « N 
y Understanding dialogue > ' y • 

^Sensing mood 

Understanding figurative language 4 



Percent 
correct 
score 

71.5 

67.3 
73.4' 
' 75.6 
58.0 
62.5 
69.3 
60.6 
65.r 

75.3 

74.9 
. 75.6 
78.4 
73.4 
77.2 
' 67.1 
77.4 



60 70 

\ Percent correct score 



Fiji- 8. Percent correct scores of California sixth grade student* for the reading skM areas of 
and interpretive comprehension, 1981-82 
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inferential 
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./ . • ■ • . 

The members of tbfe Reading Assessment Advisory Committee reviewed the 
scores |or the inferential, andjlnterpf etive skill areas with mixed epcttions, . 
noting jthat some of/the lowest percent correct scores on the test werel registered" 
in these areas. As is apparent from a comparison of scores, most of^th^xnter- 
pretive cdmpreftension questions were easier for students than were the inferen- 
tial comprehension items. In part, this difference in difficulty for students 
majr be the result of most of the interpretive items being based on l^Cjerature or 
social studies passages. ^ v > 

As\is apparent from the list of skills In the interpretive comprehension 
category, most of the intetpretive skills are associated with the study^of 
literature. The advisory committee .observed that scores above the total reading 
score of 71". 5 percent correct were registered for five of the six interpretive 
comprehension skills. Thp one exception was the area of sensing mood, in which 
a score of 67.1 percent correct was registered. These questions require students 
« to interpret, the prevailing feeling or tone of a particular selection. *As the . 
members o| the English Language Assessment Advisory Committee have repeatedly 
insisted,' students need focused instruction iri/both reading and writing that 
will sensitize them to the emotional connotations of language. 

• i 1 « 

In the 'area of inferential comprehension, the highest scores were registered 
for those skills requiring, students to infer the primary message of the material, 
skills such as drawing conclusions from Overall meaning (75.3 percent correct) 
and identifying main idea^(73.4 percent correct). The most difficult, inf eren- 
tial comprehension skills for sixth graders proved to be drawing conclusions t 
from details (65.1 percent correct), putting information together (62.5 percent 
correct), making comparisons and contrasts (60.6 percent correct), and following 
organizations (58.0 percent correct). , \ 1 

Drawing conclusions from details has repeatedly appeared as a weakness at 

all grade levels a^ the third £rad_e_for which students* 

registered the least amount of £otal gain from 1980-1982. Therefore, the low . 

score in this area at the sixth grade, did not surprise the committee members, 

4 especially since drawing conclusions from details is admittedly ^difficult 

skill to learn^-and to teach. It involves searching for a relevant detail, 

which may very well be buried in the text, and then drawing from it an appro** 

priate inference. 

t * 

Putting information together is anotherskill that is not easy to acquire, 
because^this skill involves putting together twc^ separate pieces of information, 
usually from totally .different parts of ,,the text, and drawing from them a M 
conclusion not stated in the v text. # While this Skill is difficult to teach, 
research has shown that it can.be taught, even at „the primary grade level?*, if 
students are given focused instruction*, and practice. 

The comparison and contrast questions require students to compare or ^ 
contrast some element from, the reading passage to another element in the passage 
or to some thing > person, or idea not stated or identified in the passaged 
Since comparison and contrast is fundamental to both analytical and metaphorical 
thinking, the significance of this Skill is considerable. Given its importance 
and. the Relatively low percent correct score (60.6) the members of the committee 
concluded that more time should be devoted to instructing students in the art of 
making comparisons ,and contrasts. 
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Jhe. advisory Neommittee spent a good dea]^ of time discussing the skill of 
following organization, for which, the lowest score on the test (58.0) was 
registered. These Questions require students to grasp the abstract organizational 
pattern underlying a ^paragraph or passage. The students must identify a missing 
topic or a detail missing .from a partial outline of the passage. The committee 
members realized that^his would be' a difficult skill for sixth graders^ but 
they included it on the. test because.it is commonly taught at^ the elementary 
school level and because understanding organization in writing is an important 
skill £or sixth graders \o begin mastering. While the low score in following 
organization. came aS no surprise to the committee, some committee members did 
point out that outlining Exercises, which often are relegated to the back, 
portions of study skills 'books, should not fc be. neglected, since outlining is a 
time-honored method far nurturing the development of organizational skills. 



Reading beyond the lines. 

A third level of comprehension, referred to as "reading beyond tl?^ lines" 
or critical/applicative comprehension, is, also identified in the Reading Framework . 
This is perhaps the highest level of comprehension and involves investigating, 
evaluating, and integrating information and ideas from the reading passage with 
one's own experience and/or appying them to a new context. Included in the 
category of critical/applicative^ comprehension are, the f6ur skills described and 
illustrated below. \ tr 




Critical/applicative items assess the 
ability to detect the .author, author's 
attitude ancl author's pijrpqse, separate 
fact from opinion/ cind make applicat- 
ions to a different Context. * 
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Sample it; ems from illustrative social studies, passage 



J 



In 1860 , a Midwestern stagecoach company let people 
knbw aboqjt an exciting new plan which, would affect our - ^ 
entire country* » The company planned a faster mail service 
-to California — the Pony -Express,, which would deliver" the mail • ' 
^in ten days or less. " * ■ * < 

Strong young ; meh were the riders* , Buffalo Bill was « 
'One of the famous ones*. . '^hese men had to have courage* Evecy 
day they faced many kinds of danger;* /, They had been told, 
"Remember, you travel alone and the country is wild and 
rugged. frou £iay be cold/ hungry, wet ahd tired, But you must 
s go on J TOe mail must go through.'" And it did go through! 
Over the saddl^ of the Pony' Express horses was hung a 
leather 'blanket or "mochu^a." in the four pockets of it 
Were the, tissue-thin letters* Five dollars wal the price for 
sending a letter. t / 

The route- cut directly across' from Missouri to Sacramento., 
Each rider rode nonstop for about a bundrpd miles, and then a 
new rider took over.. The horses were chosen for spewed ^and 
were changed .every ten miles. Quickly the mail was thrown 
* over the\sadd]Le of - the fresh' horse, much like a relay r&ce. 
. Horses were .saddled and ready to go at every station. With a 
leap, the rider was in the saddle^-and off like the-windl 



\ 



Which of the following is an example fc of 
an opinion? 

a M 'In*-18j60 fl a Midwesterh stagecoaqh • 
' company let'»people *know # about an* 
exciting new plan. 11 . ; , 

o "The mail must go through. 11 '* 
o "Th$ route cut directly across from 

Migsoufi to^Sacramento. " 
o' "Each rider rode nonstop for about . 
a hundred miles." 



•If 'you had lived in Missouri in 1855 and 
had posted a letter to Sacramento., yo.u 
cani tell that, it would have taken ^ w 



o longer than 10 days* 

o 10 days. - 

o 5 days. . 

o less than £ days. 
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. The scopes for the critical/applicative comprehension skill areas are shown 
numerically and graphically in Figure 1 * ^ v \ - . 



Percent 
correct 
?core . 




Readint (^otilT 

Critical/ applicative* comprehension 
Detecting author and author's attitude 

$ ' 

Detecting author's purpose 
Separating fact from opinion 
Applications to a different context 




72.7 
66.8 
67.9 



a 



65 



70 



75 



Percent correct score 



Ffg. 9. Percent correct scores of Calif orjiia sixth grade students for the reading skill areas of critical ' 
applicative' comprehension, 1981-92 
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The members of the Reading Assessment AdvirA>ry Committee* observed that most 
of the critical/applicative skills, like most inferential comprehension skill 
» areas, registered scores below that for the total reacting test _(7l.5) v The 
• members of the committee concluded that Students need more opportunities to work 
on the critical/applicative skills (detecting author and author's purpose, 
separatingHfact from opinion, and making applications to_new contexts) in order 
to help them develop critical and active reading; style, vfficfi" is "needed bothjtn 
and out of school* ' * 



Reading in the content areas*** 



The comprehension t scores were* reaggrega ted to provide score breakouts for 
each pf^the three different types 9^ passages: literature, science, and social 

studies.* This feature was incorporated into the new Survey of Bagic, Skills: 
Grade 6 to reflect the widespread concern that the reading-thinking skills be 

, taught acrbss the curriculum, as is set forth in the fallowing goal statement 
from the 'Reading Framework for California Public Schools (page 13): 

f r , « ^ ' s - ' . * 

M Student3sr\&ll develop the .ability to read with comprehension* 
appropriate written materials used in the content areas of ^ 



their school's curriculum.*' 



1 



The reorganization of the Survey of Basic Skills: Grade 6 is described and 
illustrated below. ' 



CVitkal appl»amc 
* comprchcftuon 



Interpretive 
compreb^AMon 



Reading Results, Grade Six. 




O Literature 

O Science 

□ SocmI Studies 



" Inferential 
comprchemiop 



Vocabulary and literal, inferential, • 
interpretive, and critical/applicative 
comprehension Were reaggregated by 
passage types: literature, science, and 
social studies* (There were no inter- 
pretive comprehension items based on 
science passages.) 



T 



The -percent correct Scores for .each comprehension skill area, or by passage 



type, "appear in Figure 10» 



Comprchcnsion of literature passages 

Literal* 

Inferential 
^ Interpretive . ; 

Critical/applicative 

Comprehension of science passages 
Literal 

Inferenti al^ ^ * - 
Critical/Applicative 

Comprehension of social studies passages 
Literal 
Inferential 

Interpretive * ^ < 

Critical/applicative ' 



Percent correct 
score, 

74.3 
7^.5 
72.0 
74.7 
69.9 



68.0 
76.5 
65.4 
68.4 

70.8 
75.2 
66.7 
77.0 
68.7 



65 75 

Percent correct score 



85 



Fig. 10. Percent correct scores of California sixth grade students for the reading skill areas of vocabulary 
and comprehension, by passage type, 1981-82 i 
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. Reading Results, Grade Six . 

' *?he members of the Reading Assessment Advisory Committee observed a stair- 
step pattern of "results ^across content areas moving in order of difficulty from 
literature to social studies to science. This result was not unexpected, how- 
ever , given the^llowing composite readabilities (including the Fry, Flesch, 
and Dale-Chall) fot the three types of passages: literature (6.18) , social 
studies (6. 98), and science (7.28)- Readability indexes are somewhat gross 
estimates and are best viewed as granges rather than as precise, rigidly fixed 
numbers. In this case, the readability estimates do correlate with the percent 
correct scores in the three content areas. a 

The committee members further observed that in every content area the 
lowest scores were registered in eitfher inferential comprehension or critical/ 
applicative comprehension. These data reinforced their conclusion that instruc 
tion in "reading between the lines" anci "reading beyond the lines" should be 
given high priority in all content areas across the curriculum. 

After completing their analyses of the data from the netf Survey of Basic 
Skills: Grqde 6, the members of the- committee offered the following instruc- 
tional recommendations: . 0 



. REAIHNG ASSESSMENT ADVISORY COMMITTEE'S ■ 
INSTRUCTIONAL RECOMMENDATIONS FOR GR&DE SIX 



1. .All higher level reading-thiriking skills, including inter- 
pretlve, inferential, and critical/applicative comprehension^ 
skills (or, more informally, "r^ing between the lines" and. 
''reading beyond the lines") should receive high priority in 
all content areas, across the curriculum* . * \ 

2> In the development of the higher level reading-thinking 
skills, there is a necessity for discussion to improve 
students 1 thinking and thereby enable them to put information 1 
together, draw comparisons and contrasts, infer new conclu- 
sions, make applications to different contexts, and integrate 
\ new ideas int^ t^eiY^perientes. f 

3. Reading,. including comprehension and thinking in all disci- 
plines across^ the curriculum, tyust be taught actively and 
creatively -and must go beyond merely assigning and correcting 
worksheets. , f 

4. The study of vocabulary should be intensified through oral 
'language development, broadband varied reading, and direct 
1 instruction* Such instruction should include strategies 

for increasing student awareness of the emotional connota- 
tions of words. ■ ' * , .< r 



; , " # Reading Btesults, Grade Twelve - * p 

- : * • » 

Test Scope , , • „ ' * * 1 

The reading section of the Survey of Basic Skill; Grade 12 consists of 141 
questions. These items were designed to assess students 1 attainment of a wide 
range of objectives discussed broadly in Framework ^irt Reading lox the Elementary 
and Secondary Schoo.ls of California (since updated as Reading Framework for 
California Public Schools: Kindergarten Through Grade twelve ) and specified, 
with the help of the Reading Assessment Advisory Committee, in Test Content 
Specifications for California' State Reading Tests : Grades Two, Three, Six, and 
Twelve , (Sacramento:. Califprnia State Department of Education, 1975,) As sjiown 
in Flgtire 11, both the 1 objectives an<I the questions used to assess the achievement 
of ttie objectives fall into one of four "reading skill areas ( : , vocabulary, 
literal comj>rehensio,n, interpretiye/critical comprehension, and study-locational 
' skills* Figure 11 is also an illustration of the emphasis placed ofl^ach of the 
reading 3^1 .areas in the Survey of Basic tSkills: Grade 12* , 




* * t 

Fig. 1 1 Number of questions, by skill area* in the reading portion of the Survey of Basic Skills. Grade 12 



' Reading Results, Grade TWelve ' ' ' ". ' .. 

Reading Results, for Grade Twelve ; . !iX: 

v---T ' >' v ^ f i - * ... ~ i 

For.the seventh. consecutive year, the Survey of Basic Skills: Grade 12 was 
administered ~to all California twelf th grade ..students, jfhe reading achievement 
results from this* test are shown. in Table 4. Year-to-year changes in overall;^ 
reading performance and in each of the reading, skill areas are klso shpwn in' thefV 
table and illustrated graphically in Figure 12. 

. • * ' - Table 4 ' ' . ]\[ r. 

Reading Scores of California "Twelfth Grade Students on the- . ,' 
Survey of Basic Skills; Grade .12, 1975-76 Through ,198.1-82" '' ; 



Skill area 


Number of 
questions 


Average percent correct score, by. year ^, 
in each 'skiXT area ... 


Change 
i\ 
average 
percent 
correct 
:5c ore 
198CK81 

to. 
1981f82 


•.Total'; 
change 
1975^76 

to ; 
1981-82 


1975- 
76 


1976- 
77 


1977- 
- 78 


1978- 
79' 


1979- 


1980- 
81 


19«l- 
82 


READING, TOTAL 


141 / 


64.1. 


63.6 


63,J 3 


63.2 


63.T 


63.4 


63l2 


-0.2 


-0.9 


Vocabulary 


* > 
31 


^61.3. 


60.9 


60.5 


60.2 


t 

60.0 


60.2 


. 60.1 


-0.T 


-1.2 


Comprehension 


97 . 


64.5 


63.9 


63.7 


*63.7 


63.5 


•63.8 


63.5 


-0.3 


-1.0 


Literal 


47 


69.2 


68.9 


68.5 


68.6 


68.5 


68.8 


68.6 


r0.2 


-0.6. 


Interpretive/ 
















58. 8 


-0.3 


-1.3 


critical 


50 


60.1 


59.3 


591 2 


59.0 


58.9 


59.1 


Study-locational 


13 


68.4 


67.2 


67.3 


67.4 


67.4 


68U 


68.2 


-0.2 


-0.2 



70 T 



© 
8 



60 • 



rtl— 



Literal comprehension 
Study-locational 



Comprehension, total 
Reading 



Vocabulary 

Interpretive-critical 
comprehension 





1975-76 



1 *r-. 1 

1976-77 1977-^8 1978-79 



+ 



1979-80 1 980-81 



-I 



1981-82 



Fi'g. 12. Longitudinal trends of par cent correct scores of California twelfth grade student* for the skill areas 
in reading, 1 97(-7§ through 1981-82 
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Kj&adliotg Res\xlt;s, Grade Twelve 



^/ j 5 rrs^ e c?^ lo ^*8 oq^^at^jW.are- evident 



from the data in Table 4: 



seniors continued a generally dowij- 
"/'ttard .trendT'since^?^5S?f with a flight decline pf 0.2 percent correct 
' I "y . I & fe'tbe total reading section of the Survey * this overall downward 



• tibfentf W&S i«t^|:ru|>.fc;ea pnly. : once, from 1979-80 ta 1980-81, during which a 




\i\ m \ '^V OverClt^e s^x-yeat jtejciod.'fronj jI9,7$-76 to 1981-82, overall reading 
V v ^ ,# 'f<l^rf* , ifaJiA^ , .i n jgTadd\ twelve declined by 0»9 percent 'correct* 



rrect, 



*»;perf in gradfi? 

;\ m ,\'¥f ' 0#e* the^.sam^. six^-year period, vocabulary and interpretive/critical 

' : t '\'J'.. ^,;;,^CQ5^ largest declines '(-1.2 and -1«3 percent co 

r ^5?. ct l"jfely^iv vfiile 'the least decline ■ (-0.2 percent correct) was 
'-\ U y ; V^regifc^ 

. J' jfrggto^ Results, Crade Twelve 

v "... y] £\ . 1 'The ^mbeird .of ,'the Reading Assessment Advisory . Committee t a panel of 
* V .distihguishfcd California educators with recognized, expertise in reading instruc- 
V?.*. .-A/'$^ ott ''*M a^eiisSaeVt,,; analyzed, interpreted,' and evaluated the 1981-32 reading 
;;v .. V* riej^tfj^ In this process, they examined the changes in skill 

\. K . M at^/^cford^oge .In llglti of the philosophy underlying the CAP* reading tests, 
* which stated » ; in. the tteadirig*frramework for California Public Schools, 

_ \\. . * t . The fplJowin|; discu.ssion . focuses on the tv?o levels of comprehension 
/V/ " Y&s&&ssgs& on ^he S>Utvey of Basic Skills: . Grade 12, using the terminology con- 

t'ained -lq Reading Tra^ework for California Public Schools : (1) "Reading on the 
, l$nes M ; and (2)''..^eadilft^!%tween an4 : beyond the- lines. ,r 

* . .Readirfe* on tp^ lines*^ v : >: if 



*R£aB&ag on £^e,lInes H V Refers ]tp the most bdsi,c level of comprehension atld 
involves Njyestipns th^.t. require .student? to respond to information explicitly 
sta^ecl^in ttie l$$&t. . The^skillsV/whJLch include vocabulary and literal compre- 
hei^ibh^ are brlBily. des^crit^cl ; and il'lustrated below* 




• ^Voc^faulagy - items ass'ess the ability to 
;^.^ident^y synpnyms, antonyms, and def- 
vi¥ r 4nitiQj^a of Words. 1 . «■ 

/ """to. ■ > > * 

• ^ ^i^xal TO^pprehetision itemSrassess the 

atol^SHty tOj. identify oj: remember ele- 
meiyt$^that have been explicitly statecT 

■ ^ in anpafe$age.;r, . 



eric: 



43 



Reading Results, Grade Twfelve 



Illustrative items 



In the great reyolt of 191-0,. reform-minded Congressmen 
stripped their autocratic <Speaker., "Uftcle Joe" Cannon, of 
the power to select committee Chairmen and opted for a 
cleaner system: senjorrty. • But yesterday's ^tefor-m has a 
way of becoming today's reaction. Recently, liberal Demo- m 
cratic Congressmen, staged a new uprising and all but con- 
signed seiuorifev to. the history books. They deposed two of 
the crustie.st dons in the House, at llast temporarily, and 
, # gave twS powerful chairmen the scare of their lives. \ 

Actually ,\jthe fate of alL four chairmen was left hanging 
in the balance for|a time. But the shock waves from "the ^ 
quake already had. priduced lasting, effects." Ser&te Democrats 
caught the mood by voting to select committeer chairmen .in 
the future 'by secret ballot, as their brethren in ^ the House 
do already ^ And ,in both houses, reformers had broken the 
legislative stranglehold of committee chairmen, making them • 
accountable at last to their peers . 

The current reform* described in these paragraphs was begun by: 

o Republican Congressmen • t 

- o Democratic Congressmen 
o* "Uncle Joe" Cannpn , ^ 
o Democratic Senators 

The word "peers 1 ' in the last sentence means: 



o other congressmen 

o the voters j 

o Speakers of the House 

o committee chairmen - 



The 1981-82 percent correct; scores and total changes in percent correct 
from 1975,-76 to 1981r82 are shdwn below for voc&bulf ry ahd literal comprehension. 



Percent correct, 
* 1981-82 



Changes from 
, 1975-^76 9 
to 

, *1981-82 



Vocabulary 



60.1 



- -1.2 



literal Comprehension 



68.6 



-0.6 



The members of the Reading Assessment Advisory Committee noted that literal 
cfcmprehension proved to be the easiest skill area for twelfth graders and that 
vocabulary wars the second most difficult skill. The committee members* also noted 
Hfcat the decline for a vocabulary was twice as great (-1.2 percent correct) from 
1975-76 to 1981-82 as the decline for literal- comprehension (-0.6 percent 
correct). 
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Reading Results, Grade Twelve 



Because there have been consistent declines in performance in all reading 
areas at the twelfth ^rade, the members of the committee* expressed concern that 
reading-thinking skills be emphasized in all curricular areas at the secondary, 
level* They also noted the special importance of vocabulary in this process* 
As is stated in the' Reading Framework (page 15): 

"♦••Some skills are common to all of the content areas, 
including the ability to: (1) set purposes for reading; • m 

(2) survey materials; (3) understand grkphic and illustra- 
tive materials; and (4) locate, comprehend, and combine 
information ^rom several sources* , 

Each content area subject presents unique problems 
for the reader* If students are to compre^nd the 
materials used in a content area subject, tliey must learn 
the vocabulary of fche r subject. " 



Reading between and beyond the lines.'.. 

"Reading between and beyond the lines" refers to the higher level thinking 
skills, termed interpretive L critical comprehension skills on the Survey of Basic 
Skills: Grade 12 . These questions require students to respond "with ideas or 
opinions based on the material read but not stated ; explicitly in the text!" 
This 'skill^is briefly described and illustrated below. 




Infcerpretive-critical comprehension 
items assess th& ability to relate, 
generalize, or infer from explicitly 
stated elements iri written material." 
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Reading Results, Grade Twelve 




Illustrative item 


*, ■ 

LYING IN A HAMMOCK *. 
-\ AT- WILLIAM DUFFY 1 S FARM 
, " IN PINE ISLAND, MINNESOTA 




• 

* » 

* 


^ Over my head/ I see the bronze butterfly, 
Asleep on the black trunk/ 
Blowing like a leaf in green shadow, 
.Down the ravine behind «€he empty house, 
The. cowbells follow one another 
Into the distances of the af ternoon. 
To ihy right, " ****** «>. 
In a field of sunlight between two pines,; 
The droppings of last year's horses j t . i • 
Blaze up into golden stones* 

I dean back, as the evening darkens and comes on, 
A chicken hawk floats over, looking fox^Jzcffie^ 
I have wasted my life, m ,* . 

' ; " 5V% "I . , 
l '* 

Which of the following beSfc^'aesicribes the 
speaker's hammock experience? 


* 

* 4 

♦* * 


r 


o dullness 
6 awareness 
o boredom 
o tranquillity 


• 


t * Xhe 1981-82 percent correct score and overall change in percent correct 

from 1975-76 to 1981-82 are ?3?iown below for interpretive/critical comprehension* 






, . Total change, 
. " J**. - 1975-76 
Percent correct, to * 
1981-82 1981-82- 




Interpretive/critical comprehension 58*8 ' -1.3 \ 


t r 


' The 1 members of the Reading Assessment Advisory Committee observed that 
interpretive-critical comprehension is notf only the most difficult reading skill 
nrpn nn m,o R«rvpv of "Basic Skills: Grade 12 {-see Figure 12), but it is also the 


area showing the greatest overall decline (-1. percent correct; since the test 
was first administered. Thus, the committee again insisted that the higher 
level reading and thinking skills receive greater emphasis at the secondary 
level across the curriculum. The following statement>from the Reading Framework 
(p.' 15^sj>ccintly expresses the committee's position on this issue: 

f • 
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Rea^ng Results * Grade Twelve 



W A jarder for students to comprehend written materials use# in the content 
ar6as of the Curriculum, they, should receive instruction iru-the readings 
, t;hinktng™^ki3lls -required in these T 3rejas*... 

' " . ■ ' • < 

"The "students who learn to generalize, to make judgments,* to use problem 
solving techniques, and to reach Conclusions -have much greater' assurance of 
experiencing success in the content areas than those who have not learned 
thqse skills." . • \ 1 '% 

The' decline <6f jCalifornia f s twelfth grade performance in interpretive/ 
critical comprehension paralleled that of the nati6h. In'a recently published. 
repo.gt by the National Assessment of Educational Progress, it was disclosed that 
natipria^ly, the performance level 6f 17-year-olds had declined significantly 
(2y2*pfercent) in inferential comprehension. ; 

r v In &ri eaflier publication* by the National Assessment of Educational ^Progress, 
Reading, Thinking, and Writing (1981), it was reported that students are, not 
adept at supporting their -own multiple-choice selections, analyzing materials to . 
deepen understanding, or evaluating the materials^ the^ read. NAEP also found 
thafr boys and girld who never read in their spare time or who read only non- 
fiction scored* below national levels. Experts called in by NAEP to" interpret 
the results concluded that students who do not read or, who read only nonf iction 
deprive themselves of "those literary materials that, appear critical to the 1 
building o£ imagination and to higher level reading skills.* 

The members pf the Reading Assessment Advisory Committee concluded their 
analysis with the following recommendatibns: ■ 



1. 



v 
2. 



3. 



READING ASSESSMENT- ADVISORY COMMITTEE'S 
RE GOMMENDATI ONS FOR GRADE TWELVE 



Vocabulary in the content areas and higher level reading- 
thinking and problem-solving skiils require greater 
instructional emphasis in all disciplines across the cur- 
riculum from, grade seven through grade twelve. 

Systematic attention should be devoted to finding more 
effectivd ways for content area teachers to teach students 
to learn from text in the^ various content, areas. Such 
ef forts'might include identifying strong teaching models 
at the school site level, providing ' in-service training to 
meet^the needs "6f cqjjtent" area teachers, ttnd/or hiring 
qualified reading specialists at the secondary level. 

Consideration should be given to the proposal to change 
the twelfth grade CAP- testing, to another level such as the 
end of" the eleventh grade to al'loir tiffle~for corrective 
action if there are skill deficits. ~~ 



*NAEP newsletter, P..2. 
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IV. Written Language Achievement for Grades 
jThree, Six, and Twelve 



Synopsis of ?indinfrs ' « . * 

• Grade three written language scores improved in 1981-82, and gains were 
, r shown in all 34 skill areas. ' • ' . ' . 

• A new sixth grade test was administered for the first time in 1981-82. 
The results from an equating study show that gains in written language 
at grade six, were registered for the sixth consecutive year. 

The twelfth* grade total written language score increased. 0. 1 percent 
correct from 1980-81 to 1981-82, and gains were made in five of the 
' seven skill areas. 

© The median twelfth grade student in California i$ now scoring at the 
35th percentile on national^norms ih written language, while the median 
sixth grader is at the 5'7th percentile;, end the median third grader is 
at the 56th. (See Chapter VI, "Comparisons with National Norms.") v 

Committee Recommendations 

. After reviewing the data presented in the following three sections,, 
the English Language, Assessment Advisory Committee* offered the following 
recommendations: : f • 

* . \ 

Recommendations, for Grade Three ^ 

1. Primary grade teachers should nurture fluency i A students' own writing; 
a concern tor correctness in langjage should not\ interfere with the 
major objective of nurturing' this fluency. \ 

2. More emphasis is needed 'in the area of language choices, which would 
of fer primary grade' children numerous opportunities; to learn to use * 
specific and sensory detail in their writing. \ 

3. Efforts to develop sentence and paragraph sense in primal grade children 
* should be continued. through a wide variety of oral ai\d written activities 

in which the child's active use of language is cfeat^al. * - 

4. The focus of instruction should be whole units of thoubht rather than 
fragmented pieces, of language isolated from context. * 

Recommendations for Grades Six and Twelve ' « * 

1. Writing instruction should include more writing, more teaching of writing, 
1 a greater variety bf writing assignments, and adherence to the. principles 
set forth in the Handbook for Planning an Effective Writing Program * 
(Sacramento: California State Department bf Education, 198|2). v 



*The names of the advisory committee members are listed in Appendix A. 



\ Synopsis of Finding^ Written Lafrcjuage 



Writing should be integrated r with the teaching of reading in all the 
content area.£ v - 1 ' \ - 1 ' v 

While students are engaged in the act of writing, only the process skills 
of writing should be , emphasized. Later, during the act pf editing, the 
supporting skills of writing should be emphasized as the .need arises. 

\ \ 

Teachers should do more writing themselves, especially in^the classroom 
with their students' and oh thev tqpics they assi 

Various types of writing activities and events (sufeh as writing celebra- 
tions, writing showcases, write-dthons, writing faifcs, and Writing Olym- 
pics) should be planned and conducted td Emphasize the importance of ' 
writing and to provide out-'-of-cl&ssroom audience for^tudent^' writing.' 

" ' ' ' V X ' "■ 

California Assessment Program results as well as direct assessments 
of students 1 writing should be used for analyzing programmatic, strengths 
and weaknesses and for setting goals. 



\ 



Written Language Test Results for Grade Three . . 

Test Scbpe and Foundations *• 4 

The! written, language section of the Survey of Basic Skills: Grade 3, 
contains! quest fons from 'eight skill areas that are divided into two main~cate- > ** 
gories* ^The first is "Writing Process Skills, M which deals primarily with 
matters of judgment in writing. The skills included in this category are (1) 
paragraphs} (2) sentence recognition; an£ (3) language choices. The other 
, category, "Supporting Skills," is also a necessary part of writing instruction 
>ahd inclucfes the following skills: (4) standard English usage; (5), word forms; 
X6) capitalization; (7) punctuation; and (8) spelling. These skills, reflect the 
goals and objectives stated in the English Language Framework for California 
v Public Schools: Kindergarten Through feade Twelve (Sacramento: California 

State Department of Education, 1976) ajid.the Handbook for Planning an Effective 
Writing Program: Kindergarten Through-Grade Twelve (Sacramento: California 
State Department of Education, 1982) afigp^ell as the major' written language 
skills covered in state-adopted language textbooks commonly used in California's 
/ *third grade classrooms. ' 

* 1 

Decisions concerning relafeitii emphasis and breadth of context for each .of 
x the eight skill areas were^mSc^ by the English tfang&age Assessment Advisory 

Committee, which is composed of language arts experts representing a cross section 
\ of instructional levels' and institutions from across the state. 



The committee members considered thfe following sources of information 
during the test development prefcess: 

» 

J. Content analyses of commonly 'used third grade language textbooks 

adopted by the State Board of Education 4 , . , ^ 

t 2m Field reviews of skiilarea compilations ia which teachers and curri-**" J, 

culum specialists indicated the degree of amphasis they assigned to 
L ^ each skill area and whether or not the skill in question should be 

^ assessed on the Survey 

\ * < ' . \ 

3. Reviews in which teachers judged each language iteni as to the degree 
v of instructional emphasis placed on! that particular , skill and whether 
the item should be retained, modified, or omitted. 

The language items were written to siSKilatTe actual ptpduction of written 
language as clbsely as^ possible pithin the* restrictions, of a multiple-choifce 
testing format.\ Consequently' almost all the language i,tems require pupils to 
select needed lettera, words,. or sentences for a blank in a word, sentence, or . 
••paragraph. \ ^ 

\ * ■ N < * *■ 

The relative degree of emphasis assigned to each fc^ the wtitten language J« 
skill areas within the two broad areas on the Survey of basic Skills: Grade 3 " 
is presented graphically in Figure 13. , 
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Written Language Results, Grade Three 

* ■ _ • . f 

Writing process .. ' 
skills 




Supporting 
jf* skills 

FigVl3. Number <?£ questions* by skill area, in the written language portion of the Survey of Basic Skiffs, 
Grade 3 g 9 / 



<f K Written Language Sc'ores for Grade „ Three 



The Survey of Basic Skills: 6rade, 3 was administeredJEor the third success- 
ive year/ in 1981-82* . The results of third grade performance on the language 
section of this tefst are shown in^Eable 5. Year-tfo-year changes in overall, 
perif omiance .and in -skill area performance are 'also shown in* the table. Hie 
. scores for written language and the eight major skill areas are shown graphically 
t in Figure 14 for 1979-80 through 1981-82. . *• 



Written Language Results/ Grade Thnee 



Table 5 

Written Language Scqxes of California Trfird Grade Students 
on the Survey of BaWe Skills: Grade 3 , 1979-80 Ihrqugh 1981-82 



Skill area 



WRITTEN LANGUAGE,* TOfAL 

. Writing Process Skills 

Pi>agrephs 

Tppic sentence, 
Details and sequence 

Sentence recognition 
Statements and questions 
Complete sentences 
Supplying subjects 
Supplying verbs 

Language choices ^ 
Sensory words. > , 

Specific words 

Supporting Skills 

Standard usage** 
Irregular verbs 
Pronouns 
. Subject- verb agreement • , 
.. Noun determiners 

Word forms * 
i*refixes 

Inflexional suffixes ' j 
Derivational suffixes . ' 
. Irregular noun plurals 
s Contractions » ^ 

Spelling 
t Predictables* 

Words with suffixes 
Demons and homophones 

Capitalization ' 

Persons 
1 Places 
tyays/roonths 

Punctuation 

Periods and question marks # 

Cbmmas 

Apostrophes • 



Number of 
questions 



390* 



30 


69.6 


15 


68.4 


15 


70.9 


75 ' 


78. A 


15 


74.1 


60 


79.5 


3a 


78.8 


30 


.80.3 


4 30 


66.1 


15' 


72.1 


15 


60.2 



60 
15 
15 
16 
14 

66 ' 
14 , 
12 
11 

■14' 
15, 

69 
.39 

16 
.14 



10 
10 

30 
10 
10 
10 



Mean score, 
by year 



1979-80 , 19H r 81 1981-82 



74.8 



74.2 
76.7 
73.5 
*69. 3 
7I3.0 

74.9 
79.1 
76.3 
76; 3 
65.1 
•77.8 

737o" 
80.4 
55.5 
72.4 



75.4 



70.0 
68.8 
71.3 

79.1 , 

74.9 

80.2 

79.5, 

80.9 

67.0 
73.0 
61 .0 



74.4 
76.6 
*73.8 
69.^ 
78.5 

75.2 
79.4 
76*6 
76.8 
64.8' 
78.9 

73.5 
80.7 
56.3 
73.2 



88,1 ■ 89.2 

87.3 88.5 
86*0. S7.5 



72.0 
77. 8\ 
42.4 
75.7 



73.3 
79.0 
63.7 
77.1 



76.6 



71.3 
70.1 
72.5 

80.5 
76*1 
81.7 
80.8 
82.5 

68.6 
74.1 
63.1 



75.1 
77.3 
74.4 
70.4 

78.9 

i* 

76.0 
79.9 
78.0 
77.3 
6*. 2 
80. 0_ 

74.6 
81.7 
57.5 , + 
74.3 

9D.1 

* 92' r ty** 
89! h 
88.5 \ 

74.9 
80.8 
65.2 
78.7 



Chan 

1979- 80 1980-ffl 
to to 

1980- 81 T981-8? 



+0.6 



+0.4 
+0.4 
+0.4 

+0.7 
+0.8 
+0.7 
+0.7 
+0.£ 

+0.9 
+0.9 
+0.8 



+0.2 
-0.1 
+0.3 
+0.2 
+0.5 

+0.3 ' 
+0.3, 
+0.3 f 
+0.5 
-0.3 ' 
. +1.1 

+0.5 
+6.3 
+0.8 
40.8 

+1.1 

+1.2 
+1.5. 

+1.3 
+1.2 
+1.3,- 
+1.4 
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95- 



85- 



8 75- 



65- 



Capitalization < 



Sentence recognition 



Word forms 
Written language, total 
Standard usage 
Spelling 
. Punctuation 



Paragraphs 



Lancua.ce choices 



1 

1979-80 




1 

1980-81 



1 

1981-82 



Fig. 14. Longitudinal trends of percent correct Scores of California third grarjfc students for the skill areas in 
written language, 1979-80 through 1981-82 

I 



The following observations are evident from the data in Table 5: 

» r 

• The written language score for California f s third grade students 
increased by 1.2 percent correct from 3j)80"*81 to l981<-82, and gains, were 
made in all 34 skill $reas. |he gain of 1*2 percent correct was exactly 
twic£ that of the previous year for written language (0.6 percent 
correct), yielding an overall gain of 1*8 percent co*"rect from 1979-p0 

-'to 1981-82. ♦ . . / 

• The largest. gain from 1980-81 to 1981-82 was in the area of specific 
words (2.1 percent correct) > which is a language choices subskill.\ 

• The smallest gains -from 1980-81 to 1981-82 were in the argas of, / 
Irregular noun plurals '(0.4 percent correct) and noun determiners TO. 4 , 

4 ' percerit * correct.) . » , x 

B4 5b* . 
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• Tlpe largest gains over the two-year period from 1979-80 to 1981-82 were 
« registered for the following skills: 

Punctuation ' * 2,9 

Periods and question marks 3.0 1 • 

Commas * 2,8 
Apostrophes 3.0 

Specific words 2.9 

i 

• The smallest gain from 1979-80 to 1981-82 was in the area pf irregular ' 
noun plurals (0.1 percent correct). 

• The easiest major skill area on the third gs^de written language test 
was capitalization (90. 1 'percent correct). Similarly, the easiest 
subskill felement was capitalization of persons 1 names (92.4 percent 
correct). ' » J 

• The most difficult major skill areas were language choices (68.6 percent 
correct) and paragraphs (71.3 perpent correct). The most difficult 
subskill elfeqent was spelling words with suffixes 1(57.5 percent correct). 

" u. ' • A/ K. 

Interpretation of Skill Area, Results, Grade Three 
* > 

Hie members of the English Language Assessment Advisary. Committee, a panel 
of distinguished California educators with recognized expertise in language arts 
instruction and assessment, analyzed,' interpreted, and evaluated the 1981-82 
written language results for grade three. In this process, they examined the 
changes in skill area performance' in light of .the rationale underlying the CAP 
reading tests, which is^ stated generally in the English Language Framework for 
California Public Schools and more specifically in Survey of Basic Skills; Grade 
3> Rationale and Content . 

• The following discussion focuses on tUe^two* broad clusters of skill areas 
assessed on the Survey of Basic Skills: Grade 3 ; (1) supporting skills; and 
(2) writing process skills. * 

Supporting skills.* . 
♦* 

"Supporting skills" is the term chosen by the committee for those areas of 
the tesf that deal with correctness: standard usage, word forms, spelling, 
capitalization, and punctuation. These. areas are briefly described and illus- 
trated below. , 
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Supporting Skills—Written Language, Survey of Basic Ski lls: Grade 3 

A 




Standard English usage items assess the 
ability to use verbs and pronouns,' arfd 
to .achieve' agreement in number between 
subject and ,verb, and between a noun 
determiner (for example, "this", "these", 
"that") and the noun it modifies. 



Word form items assess the ability to 
form wotds with prefixes and* suffixes, 
irregular noun plurals (for example, 
"geese," "children," and "sh^yes-X^ 
and contractions. 



• Spelling items assess the awareness of 
..predlcta&ly spelled words and words 
with suffixes. -A few familiar spelling 
demons are alsp included among the 
spelling itfems in addition to several 
homophones (for example, "bear" and 
"bare"). * * 



Capitalizationy items require pupils 
select words (such as names, place 
and holidays) vhich are correct 
capitalized. 




Maria and ( • went to the stqre* 



o me 
o I 
o her 
o him 



The valley race w&s won )>y two 



• o women 
^o woman 
* o womans 
o womens 



At the beach, Julie' put water in 
her red bu et. 



o ck 
o ch 
o k 
o kc 



There are many wh&leaf iri the 



o Pacific Ocean 
o Pacific ocean 
o pacific ocean 
o pacific Ocean 



ERLC 
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• Punctuation items, require pupils to , 
use periods, question marks , commas*, 
* and apostrophes correctly; 1 l ' 



They heard a loud 

o cry 
o cry, 
o cry* 
o cry. 



The percent correct scores for the written language supporting skills are 
shown in Figure 15 for 1981-82, along with the cumulative percent correct gains 
from 1979-80 to 1981-82; 



Percent correct . Total change, 
score, 1981-82 1979-80 to 1981-82 



Written language (total) 76.6 

Standard usage 75.1 

Irregular verbs *77.3 

Pronouns 74.4 

Subject-verb agreement 70.4 

Noun determiners 78.9 

Word forms 76.0 

Prefixes 79.9 

Inflectional suffixes 78.0 

Derivational suffixes 77.3 

Irregular noun plurals 65.2 

Contractions 80.0 

Spelling 74.6 

Predictabtes 817 

Words with suffixes ' 57.5 

• Demons and homophones 74.3 

Capitalization 90. 1 

Persons 92.4 

Places t 89.4 

Day$/months s '* 88.5 

« 

Punctuation ' . 1 74.9 : 
Periods and question marks 80.8 

'.Commas/ * ♦ 65.2* 
Apostrophes ^ 



78.} 



■ Percent correct score, 1979-80 
Q Percent correct score, 1 981 -82 




Fig. 15. Percent correct scores of California third grade students for the support jng skills 
language, 1981-82, and changes in scores, 1979*80 to 1981-82 
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The members of 'theiTcqmnlittee were very pleased with the g^ins shown for all 
supporting. ^kill^M thin Written language. From the data in Figure 15 they 
noted _ that the following supporting skills areas were particularly difficult for 
third grader^, spelling word's with suffixes (57,5 percent correct), irregular 
.noun plurals (65.-2 percent correct), and punctuation with commas (65.2 percent 
correct). \ The . r SubSkil Is that were strikingly easy for California's third 
gr^d&rs were all within the area of capitalization— Barnes of persons (92.4 
percent correct) places (89.4 percent correct), and o days /months (88.5 percent 
correct) — followed by spelling of predictable words (81.7 percent correct), 
punctuation with periods and question marks (80.8 percent correct), and contrac- 
tions (80*0 percent correct). The committee commented that the third grade 
pattern of strengths and weaknesses should be useful for planning in both 
the intermediate grades (and especially fourth grade) and the primary grades., ' . 

The committee observed that the skill areas showing the greatest increases 
'since 1979-80 are not necessarily tjie easiest areas for pupils: punctuation 
with commas (2.8 percent correct) and spelling words with suffixes. (2.0 percent 
correct). The committee members were pleased to see such consistent progress in 
all supporting skills, especially in the more troublesome areas of spelling and 
punctuation. % 

Writing Process Skills ^£0**' 

The writing, process skills tend to deal more with matters of judgment in 
writing than with matters of correctness, and they tend to .be more central to 
the process of writing. On the Survey of Basic Skills; Grade 3 writing process 
skills are&s include paragraphs, sentence recognition, and language choices, 
which are described and illustrated below. t * 
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Paragraph items assess the ability to 
Choose a sentence for a Mank in a paragraph 
Which will make sense in the context of * 
the paragraph; these items include topic 
sentences, relevant details, and necessary 
sequential elements. 



U-3 



Sentence recognition items test the 
ability to form a' complete sentence 
by supplying a needed subject or verb, 
and to .discriminate between questions 
and statements. 



Language choice items assess the 
•ability t6 select words which appeal 1 
to a given sense (For r example, a word 
such as "buzzing" would be associated 
with the sense of sound), and to 
select the most specific word in a 
list of related words (for example, 
the word "hamburger" would be identi- 
fied as more exact than "food" or 
"thing"). 





A 



They can wash windows or 
^ars. They canM^it the grass and 
M can even earn 
a lemonade 




jake leaves. The; 
•oojiey by set tin; 



o More children drink lemonade ill 
the spring and summer. 

o Many nine-year-olds are good at. 
cleaning. * 

o There are many ways for nine- 
year-bids to earn money. 

o Raking leaves is tiring work 
for children. 



The black bear \ 






o in the cave . ( 


• \ r 


i 


o was walking around \ 






.o from the mountain 






o under the tree 













Choose the one that tells exactly A 



what Lee^ tasted. 
Le-e tasted the 



on his plate. 



o food 

o vegetable 

o corn 



The percent correct scores for the writing process skills within the thir4 
grade written language test are shown in Figure 16 for 1981-82, along with the 
cumulative percent correct gains from 1973-80 to 1981-82. ^ 
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Written language (total) 

Paragraphs 
Topic, sentences 
Details and sequence v 

Sentence recognition 
Statements and question* 
Complete sentences 

Supplying subjects # 

Supplying verbs 

Language choicos 
Sensory words 
Specific w F ords 

■ Percent correct wore. 1979-80 
*Q Percent correct score. I9KI-82 



Percent correct 
score. 1981-82 

76.6 
/• 71:3 
70.1 
72.5 

80.5 
76 I 
81.7 
80.8 
815 

68.6 
74.1 ' 
63.1 



Total change. 
I979-8CT to 1981-82 




55 



65 75 
Percent correct *corc 



Fig. 16. Percent correct scores of California third grade students for the writing process skills within written language. 
1981-82, and.changes in scores, 1979-80 to 1981-82 



The members of the English Language Assessment Advisory Committee were 
.extremely pleased to see" the gains in all writing process skills. The committee 
members were especially gratified to observe the sizable increase^ in the , 
language choices areas, particular^ specific words (with a 2.9 percent correct 
cuj&aift^ve increase), since these areas have been designated by the 

cbmmittee\in previous years for special instructional attention. 1 They observed, 
however, that of the various writing process' skills, the specific words elfement 
of languag^ ^choices continues to be by far the most difficult area for third 
graders. ' }ivea this fact, the committee agreed that continuing instructional 
efforts a^e needed at the intermediate levels to help children develop^ a firm 
grasp of levels of abstraction in language that can help, them learn to make 
better use of detail, in their writing. T ; ' 

The, commit tee' observed that after language choices, the area^pf greatest 
difficulty fon third graders was that of topic sentences within pragraphs (70.1 
percent correct. ) These questions require third graders to select a sentence 
that provides a topic for a. partial paragraph presented in the item stem. The 
relatively weak third grade showing In this area led the committee to stress t 
*that primary grade teachers need to deal consistently with whole uni$£ of 
t thought as much as possible 4 and avoid fragmenting and isolating language 
elements from meaningful context. 

/■ * ' 

The members of the advisory committee were, very pleased with the high 
scores and gains (80.5 percent correct; Z.\ percent gain) in sentence recogni- 
tion, an area which the committtee has insisted is of central importance in the 
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4 



writing process* (£he committ&^'s view of the importance of sentence recogni- 
tion is reflected* by the fact that the grade'three written language test 
contains more sentence recbgnition items than^ny other type of . question. )' 

The areas that the committee found to'be of least and greatest difficulty 
are listed in Chart 1 for both supporting and writing process skills. 'The 
committee's" instructional* recommendations follow the chart. 



* , Chart 1 . ' 

Areas of Weakest and Strongest Achievement in Grade Three' 
Written Language £ or Supporting Skills and Writing Process Skills 



\L Supporting 
Skills. 



Writing 
Process 
Skills 



Skill areas showing 
strongest performance 

Capitalization 

Persons 

places 
• Days /months 
Spelling predictables 
Punctuation with periods 

'And question marks 1 
Contractions 

Supplying verbs to form 
complete sentences , 

Supply subjects to form 
complete sentences • 



Skill areas showing 
weakest performance 

Spelling words with suffixes 
Irregular noun plural^ 
Punctuation with commas 



Selecting specific words for' 
precise language choices 

Supplying paragraphs^with topic 
sentences. > 



5—76446 



ENGLISH LANGUAGE ASSESSMENT ADVISORY COMMITTEE'S 
INSTRUCTIONAL RECOMMENDATIONS F0£ GRADI? THREE 

!• Primary grade teachers should nuj^ure fluency in students 1 
• own writing? a concern for correctness in'language should 
not, intjerferewifch the major objective of nurturing this 
fluency. 

* * 

2. More emphasis is needed in the area. off language choices, 
which would offer primary grs^de childlh^n^I^umerous 
opportunities to learn to use specific and sensory detail 
in their writing.. % 

3. Efforts to develop sentence and paragraph sense in primary 
grade children should be continued through a wide variety 
of oral and writ-ten activities in which active use of 

•language is central* % ' "* 

4. The focus of instruction should be whole units of thought 
rather, than fragmented pieces pf language isolated fxom 
cogtextp "* 

» 
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Test Scope .and foundations - . 

In 1981-82, a 'new sixth grade test, the Survey of Basic) Skills Grade 6 , 
was administered for the first time. The written language section' of the 
Survey of Basic Skill s; Grade 6 contains questions from nine skill areas that 
are divided into two main categories. The first is "writing process skills, " 
which deals primarily with matters, of judgment in effective writing. The 
skills included in this category are (1) judging student writing; (2) para- 
graphs; (3) sentence combining; (4) sentence recognition; and (5) language | 
choices. The other category, "supporting skills,", is alsp a necessary part of 
writing instruction, and includes the following skills: (6) standard English 
usage; (7) word forms; (8) capitalization 'and punctuation'; and (9) spelling. 
These skills reflect the goals and objectives stated in the English Language 
Framework for California Public Schools; Kindergarten Through Grade Twelve and 
tn f H?"<*book for Planning a rt Effective Writing, Program as well as the maior 
written language skills covered in state-adopted language textbooks commonly 
used in California's sixth grade classrooms. ... * 

Decisions concerning relative emphasis and breadth of content for each 
of the nine skill areas were made by the English Language Assessment Advisory 
Committee, which is composed of language airts experts representing a cross 
section of instructional levels and educatibnal institutions across the 
state. ' , 1 

The committee members considered the following 'sources of information during 
the test development process: 

' 1< Content analyses of commonly used sixth grade language textbooks adopted 
by the State Board of Education. 

2. t Field reviews of skill area compilations in which teachers and curriculum 
specialists indicated the degree of emphasis they assigned to each skill 



area. 



3. 



Reviews in which teachers judged each language item as to the degree of 
instructional emphasis placed on that particular skill and whether the 
item should be retained, modified, or omitted. • 



i 63 
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The relative degree of emphasis assigned to each of the written language 
areas in the Survey is presented graphically in Figure 17. For an 
description of all reading skill areas and underlying rationale, see 
Basic Skills: Grade 6. Rationale and Content . 

Writing process 
.skills. 



skill 
strated 
Skirvey of 




' 7 .'^""-Supporting 

, " . ' ; ' skills' , . ■ 

Fig. 17. Number of questions, by skill area, in the written language section q! the Suriey, of Basic Skills: 
Gride 6 , 1 ' 



. Written Language Resu lts' for Grade Six 

The SurV teyoj B««»lc Skills: Grade 6 was administered for the first 
. time in 1981-82. The results of the written language section of this test 
are shown in Table 6, and the major skills are displayed graphically in 
figure 18. * 
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:able 6 - 



Writ tea Language Scores 
on the Survey of Ba 



of Calif.ornia Sixth Grade Students 
ic Skills: Grade 6, 



1981-82 


"No. of 




questions. 


Mean scon 


342 


73.3' 


182 


72.6 


22 


71.4 


• 40 , 


76.1 


10 


74.2 


10 


' 77.0 


10 


71.7 


10 


81.6 


50 


66.8 


13' 


52.0 


13 


66.0 . 


14 


68.9 


10 


84.3 


40 


75.2 


13 


90.5 


13 


84.7 


14 


52.1 


30 " . 


75.0 


10 


75.8 


10 


67. 1 


10 


82.0 


, 160 


- 74.1- 


50 


78,2 


10 


77.5 


10 


66.7 


10 


72.4 


10 


91.2 


10 


83.0 


32 


74 6 




' 7Q A 


10 


71.3 


12 ' 


73.2 


50 


71.2 


ID 




15 


" 64.4 


10 


76.8 


10 


' 7>0 


28 


71.5 


14 


70.6 


14 


72.4 



Skill area 



WRITTEN LANGUAGE, TOTAL. 
Writing Process Skills 
Judging student writing 



, Paragraphs * • 
Topic sentences 
Details and sequence 
Outlines for organization 
Consistency of verb and pronoun usage 

Sentence combining ^ • * 

Simple sentences with modification 
Compound sentences and -sentence parts 
Complex sentences * 
Conjunctions ^ 

Sentence recognition 
Supplying subjects 
Supplying verbs 

Forming complete sentences ^ 



Language choices 

Sensory wards 3fc 
Specific words and sentences 
Achieving tone through word choices 

Supporting Skills . . „*„. 

Standard English usage 
Irregular verbs 
Pronouns 

Subject-verb agreement 
Noun determiners % A 

.Double negatives- 
Word forms 

Suffixes' 1 " • » " 

Irregular noun plurals 

Contractions * 

■ > ' 

. Spelling 

Predictable words 
> Words, with suffixes * . * 
Demons ■ 
Homophones 

Capitalization and punctuation 
Capitalization c 
Punctuation , • 

66 
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Standard English usage • 



Paragraphs 



Sentence recognition • 



Language choices ■ 



Word forms • 



Written language, total I 



Capitalization and punctuation —r 



Judging 'student writing' 
Spelling ■ 
Sentence combining* 



6Q 

Percent correct score 



70 



80 



Fig. 18. Percent correct scores of California sixth grade students for the major skill areas in written Ian 
guage, 1981-82 ^ < 



The following observations are evident from the data in Figure 6. 

» The easiest major Skill area was that of standard English usage (78.2 
percent correct )» while the most difficult, major skill area was sentence 
combining (66.8 'percent correct). 

• Among subskill elements, the easiest areas were noun determiners (91.2 
percent correct) and supplying subjects (90.5 percent correct). { < 

• The most difficult areas among all the Isubskills were those of simple 
sentences with modification (52.0 percent correct) and forming complete 
sentences (52.1 percent correct). , 
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Interpretatlpn-q^^ki'll Area Results, Grade Six 

» V. J - ' ! H ■ . • 

The members of .# the English .Language Assessment Advisory Committee* a . * 
panel of outstanding California educators with recognized expertise .i^i/language 
arts instruction and assessment, ajtelyzed, .interpreted, and evaluated tRe 
1981-82 written" .language results for grade six. In this process, they reviewed 
the scores in the* written language skilX areas in light of the philosophy 
underlying t^e CAP writt/en language tests. This philosophy -is stated generally 
in the English .Language Framework and more specifically in Survey of Basic 
t Skill$: Grade 6, Rationale and Content . 



. T^he following* discussion focuses on the two broad clusters of^skills 
assessed on' 'the, Survey of gasic Skills;' Grdde 6 : (1) suppotting skills 
and (2) .Writing, process skills. 

Supporting sVil'ls... " „ * 



"Supporting skills" is the term chosen by the committee for those areas of 
.the tes't that de'al with" matters of correctness. .These skills, which include 
standard Usage, word forms, spelling, and "capitalization and punctuation, are 
briefly <ies bribed *and iflustrated below. 




7T\ 



• Standard English usage items assess 
the ability to use verbs and pronouns, 
*to avoid double negatives, and to 
achieve' agreement in* number between , 
subject and verb, and between a jfi&uh t 

: determiner (for example', "thisr^ 

• "these," rt that")>and the noun it 
modifies. \ " \ 

• Word form items assess ^the ability to 
^ form words with suffixes, irregular 

liounplural's (for example, "geese," 
/'chil^en-^" and "shelves"), and con- 



tractions. 




• Punctuation and capitalisation item 
.require" pupils t6 use periods, ques 

tion marks, commas, apostrophes, 'a 
quotation marks correctly,^ a 

♦ select words (such as n^me^T, places 
and holidays) whacfcr^re corredtly 
capitalizedL^-^^ \ 

Spelling .items assess the ability to 
spell predictable words (that is, 
words that can be* taught in word 
families or groups following similar, 
genetalizable ^patterns) ; wprds with 
predictably-speilecl suffixes; demons; 
and homophones (such as "to," "too," ' 
and "two"). 
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Illustrative items 



Tl\e teachet saysC Fill in the bubble 
>'«*e*f to tbe one that completes trhe 
sentence correctly 



The cats 



togethet, 



o . was playing 
o plays 
xO wer<r playing 
o is 'playing * . 



*£fcanda£cll English usage 



r : — r 1 ? 

. The teacher saysf Fill in the bubble 
next to :>the* one jtfuch completes the 9 
sentence 'correctly* 

* Our^h^gh school band includes ; 

c ' trumpets, and drums . k 

i ' o • *£Arinets 

^nfijjsfly inetta , 
^ d a|prii>ets. v 



Punctuation and capitalization 



The teacher says: Fill in the bubble r 
next to the one which; completes .the 4 
sentence correctly. 



■r 



His 



was greatly appreciated* 



o kindly 
o kindness 
o kindest 



Word Forms 



The teacher says: On the dotted line, 
tj/r'ite out the word with the missing 
letters. Now choose the letter or , 
letters needed to spel^l "the word' ; 
correctly* and fill in the bubble' 
next to the one you choose ♦ 

We will go swd m . 'every tijry. 
o- in* t 



o' 4 eing 
' o in 










• 


* —~ 
Spelling 






* * 

* 

* 










4 

4 

*; 







The scores for the suppprting skitls wfftiin the sixth grade written language , 
<£est' j»re stiSwn numerically and graphically in Figure 19, 
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♦ . •' «» 
Written Iantu»teTtota! 

t 

- Supporting skitls 

Standard English usage • - 

Irregular verbs 
' Pronouns * 

^ubjccVvcrb agreement 

' Sloun determiners 

1 . ; 'Double Negatives 
* 

j\ Word forms t % * 
Suffixes • 
Irregular noun plurals ■ 

Contractions ■ 

t 

Spelling « 
. y Predictable -words 
Words witksuffixcs 
Demons 
Homophones 

Capitalisation' and punctuation 
^Capita fizat ion r 
Punctuation 



Percent 
correct, 
score 



74.1 

78.2 
77 v 5 
66.7 

n.A 

91.2 
83.0 

74.6 
79.6 
71.3 

,73.2; 

71.2* 
73.2 
64.4 
v 76.8 
72.9 

71.5 
70.6 
•72.4 




rv 



60, ' 70 80 

" Percent correct score • 

Fig 19 Percent correct scores, of California sixth grade students for the supporting skills within written * 
— ".^ language, 1991-82 *l 

Thfe njembers of the English language' Assessment , Advisory Committee studied 
these results and observed that most 6f the scores for the written language 
supporting skills tended to cluster between 70 an* 80 percent correct. Four 
subskills prQ^ed tb be exceptions to this pattern, two of which 'were easier and 
two of wte^h Were harder for, students than the other skills. The^ cluster of 
noun determiner items (using words like "this," "these," and "that" (Sdrrectly) 
was by far the easiest written language subskill .on the test, witl/an averagg 
score pf 91.2 percent correct. On similar questions on the third grade test, 
students registered a relatively high score also :( 78. 9 percent f correct), but 
the sixth grade data suggest that nearly iomplete mastery* has occurred in the 
'use noun determiners by the end of sixth grade. The second easiest sup- 
porting skill score was that for the area of double negatives. While some 
litems were more difficult than others (es'pe^ially constructions using words 
like "hardly," "nobody and "no one"), 60 to 90 percent of the students Y * 
demohstrated the ability to avoid double negative? in most cases*, The lowest 
scenes among the supporting subskills Were for spelling words with suffixes 
(64.4 percent correct) and using pronouns (66.7 percent correct). The members 
of the committee were not surprised at the score registered fpr spelling words- 
with suffixes, given the difficulty flhis troublesome skill pfesents , to students 
at. all levels. Nor were they surprised at the relatively low score for the 
pronoun skill area, in which scores typically fluctuate greatly from item to 
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item at the elementary school level. The committee members believe. that the 
inconsistent performance in this skill area at grades three and six is the 
result of students 1 not being mature enough to determine correct pronoun usage 
from grammatical rules; 1 instead, they appear' to )>e relying on the sound of 
language in making their choices and are "overcorrecting" in some cases (for 
example, in such constructions as "Show it to Pat and I"}* 

■ s 

riting process skills... 



}, 



The yriting process skills are more central than supporting skills to the 
process of writing and deal more with choices, decisions, and matters of judg- 
ment than with matters of correctness. Five skill areafc on the Survey of Basfic 
Skill's: Grade 6 deal with writing process <skill&: judging student writf^, , 
paragraphs, sentence combining, sentence recognition, and language choices. 
Each of these skill areas is described and illustrated below. 
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• fudging student writing items assess tin? 
ability to identify from corrected 
samples of student writing particular 
A&lZngthA, such 'as; recognizing effec- 
tive use of detail; unified paragraphs 
in which all the sentences support the 
topic sentence; Tetters yhich success- 
fully communicate a message; and imag- . 
ink tive ideas , as well as UfcaknZMZA, 
v such as: recognizing* repetitious para- 
graphs; paragraphs c which drift, away from 
the topic; essays with many short , 
. choppy sentences; persuasive letters 

which fail* to present convincing argu- 
* ments; and essays which lack a strong 
introduction or conclusion. 
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• Paragraph items- assess the ability to ■ 
chopse, a sentence for a" blank in a para- 
graph which will make sense in the con- 
text of the paragraph; these items 
include topic sentences, relevant 
details, necessary sequential elements/ 
details selected according to an out- 
^.ine /( and verljs or pronouns grammat- 
ically consistent with the rest of the 
paragraph. 

m Sentence combining items, assess the 
r' Ability to ;foxm effective sentences * , 
from a set of simple ..sentences. The 
effective seiit^nces presented as the 
correct' answers^ include (1) simple 
sentences with modification and inter- 
rupters (such as appos'itives) , (2) 
compound sentences or sentences with 
compound parts, and. (3) complex sen- 
tenqeS. Another cluster of items ' 
.assesses the ability to use conjunc- 
1 tions by (1) requiring the choice of 
a sentence which follows logically 
from another given statement and con- 
junction (e.g., I>like cake, but 

= .), and (2) requiring 

the choice of a conjunction in a 

sentence (e.g.; I like cake, 

I don't like pie.). 

Sentence recognition items test the 
ability to form a complete sentence by 
supplying a needed Subject or Verb, 
and to discriminate between complete 
sentences, run-ons , and fragments. 

• Language choice items assess the ability 
to select effective or appropriate words 
for particular purposes, including the 1 
following: (1) specific words or, sen- 
tefices" which will provide the most 
detailed or exact information 1 (for 
example, the word "apple" would be iden- 

«*tlf ied* as, mo.re exact than "fruit" <3r * 
"food 11 ); (2) words which appeal to a 
given sense (for Example, a word such as 
"bu22ing" or "screeching" would be 
associated with the sense of sound); and 
(3) woifds which will achieve a particula 
t<?ne or . feeling (for example, "stingy" 4 
is associated with a more negative 
feeling than "thrifty") 4 
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Illustrative questions 



Read the student letter, and answer 
the question below. 

flea* Vega, 

I think the. tidal pool* would be 
a <un ptacz t& go fa* thz {iith 
QAKLdzJU, li would be vzty inUsiz&Ung 
and &un. Plzc^z zonudZA thit> izquztt 
0Mz{ulhj p 

Voufijf tAuly, 
Pat Jone^ 

Suppose your friend oust, wrote T this 
' letter* What advice would help her 
make it »ore convincing to* the 
principal? < 

, C- , t 

o Indent "Dear Mr. Vega." 
o Add Mr* Vela's address, in the 
upper right-hand corner of 
. the letter* " 
o Mention the dangers of going to 
the tidal pools* 
' o Add examples of what could be 
. learned by going* 



J 




The teacher says: Cnbose the one 

below which combines the numbered 

sentences in the best way. - 
« 

1. Roller skating is a sport. 

2. Roller skating is challenging* 
3* Roller skating is growing in 

popularity* 
4* Roller skating is played indoors 
and out* 

o w Roller skating is a sport, and it 
is growing in popularity, and it 
is placed indoors and out, and it 
is challenging* 

o Roller skating, a challenging 
sport growing in popularity, is 
played indoors and out* 

o A challenging sport, roller 

skating. It is played indoors and 
out and is growing in popularity* 



Sentence combining 



* Judging student, writing 



The following outline was used m 
writing tfie paragraph below it* 
Choose *the sentence needed to com- 
' plete the paragraph according to » 
the out line * v \ • , 

,1. Athletes don»t get tat 

A. Example — tennis-player s 

— ""-B* Otheif^exaftfaes^ymTaOTS' 
v . t and wrestlers , 

C. Conclusion— strict diets 

Most successful athletes don't 
allow. themselves to become fat, 
^ because extra weight slows them down* 

If they are ten .pounds 



overweight, they may be showed down 
by ten percent* Gymnasts and wres- 
tlers must also be careful not to 
increase their body weight .in order 
to compete successfully* athletes 
usually maintain rather strict diets 
thatfe keep their weight ddwn* * 




There are many sports which I 
enjo£\ watching. 
Tennis) player 34*1 or example , have 
to move with lightning speed* 
You can Play tennis at any age* 
Staying on "a diet 4*, difficult. 



The teacher says: Choose the one * 
which will form one or more complete 
sentences. 

We gfffcanping* to get sway f rot» t 



o crowds, we enjoy the peace and' 
quiet* 

o crowds* To enjoy the peace and 
quiet* ■ 

^o Crowds. ,We enjoy the. peace and, 
quiet. 

o crowds. Enjoying the peace and* 
„ . quiet. _ r 



Sentence recognition 



Paragraphs 



Select the one which wouU >]tvo a 
reporter thc.noit detailed infornat^on 
about what Ton and Sarah saw. 

Sarah and Ton stopped suddenly. On 
the street in front of them .they saw 



sc«t space ships with funnf-looking 
people in* them looking out the 
window „ 

three saucer-shaped ships with , 
green, yellow, and orange tiny 
creatures frowning at the blue 
three Urge ships with ton* people- 
in the* who were just sitting there^ 
you know, big ships, very funny- 
looking guys and some other stuff 
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. "' Written Language Results,' Grade?. Six: V 



«• Tfte; percent correct scores fofc.' the writing process ifcLlli witKin the 
* " • of ; Basic Skills; Grade 6 a re 'shewn in E-teure 20- 



Suryey 



Written langua'gt, total . 

Writing-^proccss skills 
Judging; student writing 



Paragraphs 
Topic sentences 1 
Details and sequence 
Outlines for organization 
Consistency of verb and pronoun u&ge 

Sentence combining \ 
Simple sentences with modifications 
Compound sentences % and sentence parts 
Complex sentences 
Conjunctions 

Sentence recognition 
Supplying subjects 
Supplying verbs 
Forming complete sentences* 

Language choices 
Sensory words f 
Specific words and sentences 
Achieving tone through word choices > 



Percent 
correct 
score 

73.31 



72.6 
71.4 

7*6.i 
7|'.2: 
77.G 
71.7 
81.6 



66.8 
52.0 
66 
^68 
84.3 



t 



75.2 
90,5 
84.7 
52.1 

75.0 
75.8 
67.1 
82.0 



* ^0 • 52 



-+- 



4- 



62 -^72 

Percent correct score 



82 



92 



Fig. 20 Percent correct scores of California sixth grade student* for the writing process skills within 
written language, 1981*82 * # 
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Written Language Results, Grade Six 



9 

The members.. of the English Language Assessment Advisory Committee were 
pleased with the scores for most of the wri-ting process skill areas. They 
observed that, as 'tfttftij^ J&frd graders^, supplying subjects and supplying 
verbs to form complete sentences were the easiest writing process skills for 
sixth graders^ They also noted with pleasure the high scores on items requiring 
students to uie conjunctions appropriately. The writing process skills that 
presented the greatest degrees of difficulty for sixth graders"^ere in the areas 
of (1) sentence combining; (2) sentence recognition; and (3) language choices: 

The sentence combining exercises requirp^students to select the most 
effective way to combine several numbered sentences presented in the item st;em. 
The correct. anstfer is typically a simple sentence with an appositive, a compound, 
or complex sentence.". The members of the committee observed that the syntax of 
these items tends £o be too complex for most sixth graders but that as native , 
readers of English, most should be able to determine the correct choice by 
eliminating the exceedingly awkward distractors. The committee concluded, th^t 
the- weak sixth grade showing in" this area underscores the need for continuing 
work with sentence combining exercises in junior high and high school. 

The.second area of greatest difficulty, forming complete sentences, is 
another skill that is introduced in the sixth grade but that involves consider-' 
able experience at tt\e upper grade levels before mastery can be expected. While 
sixth graders demonstrated understanding of . the need^ for a subject and verb irf 
most sentences, as evidenced by the high scores in th'e other sentence recogni- 
tion subskills, they are still displaying a great deal of confusion when re- 
quired to discriminate between complete sentences, sentence fragments, and ; 
run-ons. This pattern yas consistent with the* expectations of the committee, 
given the comparative difficulty of the two Icinds of „ sentence, recpgnition 
skills. * Again, the committee members concluded that students 1 poor 'performance 
underscores a need at .the junior high level* for continuing writing experience 
and ^instruction that, will help students develop a more matufce sense of complete 
sentertce structure* - - - -.«rt£- 

In the area of language choices, the subskill showing the weakest perform- 
ance was vthe- cluster of items requiring : students to select the most detailed 
information for a given audience. Students at both grades three and six con- 
tinue to exhibit considerable confusion Jfhen dealing with levels of abstraction 
(chOiQes between vague, general statements and more specific ones) and the use 
of detailed information needed by. a particular audience. The advisory committee 
has consistently stressed the importance of this Skill area because fundamental 
to the writing process is an understanding, of . the information needs of a par- 
ticular audience. Furthermore, research has 'shojwn ptfat vagueness and generality 
continue to lessen' the quality of student writing at all grade levels. 

the areas showing the weakest 4nd strongest achievement in grade six, are 
presented in Chart 2 for both supporting and writing process skills* The 
committee f s instructional recommendations for gr&de six follow Chart 2. 
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Chart 2 * 


• 


Areas of Weakest and Strongest Achievement in Grade Six Written 
language-for Supporting -Skills ahd Writing 'Process Skills 


» 








Skill areas showing 
strongest performance 


Skill areas showing 
1 weakest performance 


Supporting 

Ql>4 lie 

i 

i 


Using noun determiners 
* 

Avoiding' double negatives . 


Spelling words, with suffixes 
* 

Using pronouns 

4 » 

i 

f * 




* f 


i 


Writing 

Process 
Skills 

> » * 


Supplying subjects to form, 
complete sentences- * 

A 

Supplying verbs co form , 
complete sentences 


Sentence combining 

^Forming complete sentences, 
(artd avoiding fragments „ 
ana run-ons) 




Using conjunctions. . 

■ 

- ■- * - - . ■ k - * 


Using specif ic .words and 
sentences to provide 
sufficient" information and 
detail for a given audience t 

» »* » 

* 

( r— - 




• » * • * 
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Written Language Results, Grad£ Six 



English Language Assessment Advisory Committee's 
. Instructional Recommendations far Grade Six 



Writing instruction should include more writing, more teaching of 
writing, a greater variety of writing assignments and adherence to the 
principles set forth , in the Handbook fog F^aftning an Effective Writing 
Prdgram. ~ ^* " : 

California Assessment Program results ajs well as assessments of students' 
writing should be used for analyzing strengths ancjl weaknesses in 
students' writing and fox setting goals. * ^ 

Writing should be integrated with the teaching, of reading in all content 
areas. 7^ 

While students are engaged in the act of writing, only the procesfe 
skills of writing should be emphasized* Later, during the act of editing 
the supporting skills of writing should be emphasized as the need arises. 

More emphasis is needed in the areas of language choices, Vocabulary 
^development, and sentence combining in the intermediate grades as well as 
throughout junior high school. 

The focus of instruction should be whole units of thought rather than 
fragmented pieces of language isolated from context.' 
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Written Expression Test Results for Grade Twelve 



Test Scope 



The written expression section of the Survey of Basic Skills: Grade 12 
consists of 142 questions. The items were selected to assess the students' . 
attainment of a wide variety of objectives compiled by the English Language , 
Assessment Advisory Committee and published in Test Content Specifications - 
for the Survey of Basic S kills: Written ExpressiolTa'nd Spelling. Grades Six 
and Twelve (Sacramento: California State Department of Education, 1SLZ*). Both 
the objectives and 'the item^ used to assess achievement of the objectives fall 
into one of six major, skill areas: word founts, language choices, sentence 
recognition, sentence manipulation, paragraphs, and capitalization and punctua- 
tion. The emphasis placed on each of the written expression skill areas in the 
Survey of Ba>s lc Skills: Grade 12 is shown in Figure 21. • ' * 

Sup/5rting 

- skills , 




4& 



Writing, process 
skills' 



fig. 21 . Number of questions, by skill are., in the written expression section of the Survey of Basic Skills: 



Written Expression Scores for Grade Twelve 

The results of twelfth grade^ performance on -the total written expression 

'rtllT v °' f ^ ! kiU a ' rea8 ' for l 975 - 7 6 through 1981-82 are Resented in 

lable//. Yeaf-to-year changes in overall performance and in skill performance 
are also shown in the table and are presented graphically in Figure 22. 
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Written Expression Results/ Grade Twelve 



Table 7 



Skill area 



Written Expression Scores of California Twelfth Grade Students on the 
, , Survey 6f Basic Skills: Grade 12, 1975-76 Through 1981-82 



Number of 
questions 



Average percent correct score, 
by year, in all skill areas 



Change in average percent 
correct score, for all 
skill areas 



1975-76 



1976-77 



1977-78 



1978-79 



1979-80 



1980-81 



1981-82 



1980- 81 
to • 

1981- 82 



1975-76 

to 
1981-82 



WROTE 1 ! EXPRESSION, TOTAL 

Word forms 
language choices 
Sentence recognition 
Sentence manipulation 
. [Paragraphs 
Capitalization and 

punctuation 
Spelling 



142 

24 
32 
20 
12 
26 

28 
72 



62.3 

7&6 
66.9 
67.3 
42.9 
59,9 

54.6 
68.0 



61.9 

72.1 
66.7 
67.7 
42.9 
59.1 

54.3 
67.9 



62.1 

72-.1 
66.6 
68.4 
43.4 
59.3 

54.7 
68.4 



62.4 

71.9 
.66.6 
68,8 
43.7 
59.7 

55.4 
* 68.4 



62.4 

72.2 
66.3 
69.0 
43.7 
5&7 

'' 55.4 
68.8 



63.1 

72.5 
66.7 
70.1 
44.3 
60.2 

56.6 
69.0 



.63.2 

72.1 
66.9 
70.1 
44.6 
60.5 

56*8 
69.5 



40.1 

-0.4 
-K). 2 
-0- 
-tO.3 
-K). 3 

-tO. 2 
-K). 5 



40.9 

-0.5 
-0- 
+2.8 
+1.7 
-tO. 6 

+2.2' 
+1^5 



75 T 



7(5-- 



65 ■• 



g' 60 



45- • 



i 



Word forms 



Spelling 
Sentence recognition 
. Language choices 



* 'Written Expression 

Paragraphs 



- 55" • Capitalization and punctuation 



SO-- 




¥ Sentence manipulation'* 



1 i 



1 975-76 1 976-77 . 1 977-78 1 978-79 1 979-80 1 980-8 1 1081 -82 



Fig 22 . Longitudinal trends of percent correct scores of California twelfth grade students for tfie skill areas 
* in written expression, 1975-76 through 1981-82 
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Written Expression Results, Grade Twelve 

The tollowing observations are apparent from the data in Table 7. 

• The overall twelfth grade written expression score increased from 63.1 
percent correct in 1980-81 to 63. 2 .percent correct in- 198P82, ( a gain 
of 0.1 percent correct. 

■ f - 15 ' 

o From 1980-81 to 1981-82, gains were registered in^five of the seven 

skill areas, with the largest increase Occurring impelling. 

• No Change was registered for the skill area of sentence recognition, 
while word forms showed- a decline' of 0.4 percent correct. 

• In the last six years, from 1975-76 to 1981-82, the largest gains were 
made" in the areas of sentence recognition (2.8 percent correct), capital- 
ization and punctuation '(2.2 percent correct), and sentence manipulation 
(1.7 percent correct). No overall change has been made in student 
performance in language choices since 1975-76 (despite increases the 
last two years), and the score for word forms has declihed 0~5 percent 
correct since. 1975-76. 

Interpretation of .Skill Area Results-, Grade , Twelve . . t 

The members of the English Language Assessment Advisory Committee, a, panel 
of .distinguished California educators yith recognized expertise in language arts 
instruction and a*ssessment, Analyzed, interpreted, atid evaluated the 1981-82 
written language' results for grade twelve. In this process, they examined the 
changes in skill area performance in light of the Handbook for Planning an 
Effective Writing Program ? which .includes standards for assessing the quality %f 
a school's writing program* * The philosophy stated in the handbook is that 
writing should be a major component across the curriculum, with skills instruc- 
tion ift a supporting capacity. The following discussion addresses the two broad 
areas of skills assessed on the written language portion of the Survey of Basic 
Skillsr: Grade 12 : (1) supporting skills ; and (2) writing p'rocess skills. 

• v • 

\ ** " • * * 

Supporting skills... ' 

"Supporting skills 11 is the term used by t^e committee for those areas of the 
test that deal with matters of correctness and mechanics. These skills, which 
include word forms, spelling, and capitalization and punctuation* are described 
and illustrated below. * 




* k Written Expression Results, Grade Twelve 

Supporting skills 




Word form items assess the ability to 
selectthe appropriate inflectional 
suffix (-ed, -ing, -s, -ly, -er, 
-est) for a given sentence, discrimi- 
nate between form class words (such 
as nouns and verbs) and structure 
words (such as prepositions) , and 
demonstrate dictionary skills for a 
variety of purposes. 

Capitalization and punctuation items 
assess the ability to recognize 1 
capitalization and/or 'punctuation 
error^ in sentences. 

Spelling items assess the ability to 
identify correctly spelled and 
incorrectly spelled words that are 
underlined in a given sentence. 



Illustrative items 



r 



The dogs had 

o survival 

o survivors 

o surviving 

o survived 



the long trek. 



Word forms 



Identify any capitalization or punctu- 
ation errors in the underlined parts 
of the following sentence. 

The Billst'Vho h*ve Dust returned 
K 

fcoa lake Tahoe, are already planning 

a next winter's trip. No Error . 
— D 

0A0B0C0D 



* Fill in the" oval next to "right" if 

the word is spelled correctly or next 
to "wrong* if the word is spelled 
incorrectly, 

Carmen steped on my toes, 
o Right o Wrong 

Spelling 

» 80 8 X 



Capitalization and punctuation 



J 



Written -Expression Results/ Grade Twelve 



The percent borrect scores for 1981-82 and t;he total changes in percent 
| correct ftom 1975h76 to 1981-82 are shown below for the supporting skills within 
written expression: *' V . [ 



Written expression (total) 
Word form! 
Spelling 

Capitalization and punctuation 

The members! of the English Language Assessment Advisory Committee were 
pleased by the store increases for spelling and capitalization and punctuation; 
they were puzzled, h'owever, by the decline in scores fQr word forms, which is 
the easiest skilfl. area on the Survey of Basic Skills: Grade 12 . The commi tpeeT^ 
members speculated that this particular skill area is so basic that litj 
instructional time is being devoted to it in mdst high schools. -The^members of 
the comfaittee recommended that tfie following principle from the Handbook for 
Planning an' Effective Writing Program (p. 18)' be adhered to in teaching all 



Percent 


Total 


Correct 


Change 


63.2 


+0.9 


72.1 ' 


-0.5 


69.5 


— +1.5 


. 56.8 


+2.2 



writing- skills: 



"Students can best, develop their -skill with the 
conventions of writjlttg as the need for it arises 
in their work, rather than according to a flexed 
program. Writing itself,, then, becomes^tRe basis 
for determining which skills need tA^-bfe learnfed 
6y which students ^and at which time." 



Writing Process Skills 

The writing process skills tend t to deal more with matters of judgment 
than with matters of correctness and^tend to be more central to the process ^of- 
writlng. 'The writing process skills on, the Survey of Basic Skills: Grade 12 
include paragraphs, sentence manipulation, sentence recognition, and language 
choices. *Each of these is described and illustrated belofo.^ ^ 
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4 » 




• Paragraph items assess the ability to 
, '^identify irrelevant material in a 

paragraph, recognize inconsistent 
time development select the logical^ , 
sequence' of a grou^ of sentences, 
select" t;he sentence which best 
summarizes the ideas presented in one 
or more 'related paragraphs, and 
identify traditional elements within 
a paragraph. 
. - t 

• % Sentence manipulation* items Assess the 
ability to Select the most economical, 
effective sentence, and recognize 
effective ' coordination and' subordina- 
tion within sentences 




• Sentence recognit 
/ability 



Ltk>n k i£ 



ems assess the 
, to -recognize complete sen- 
tences/ seAence par?s, sentence* 
P9tternj9» and the appropriate sub*jectr 

vejrb ^relationship. * 
* 

* Jlangua e g6 choice it-fems assess the 

'ability to identity attitude-conveying 
jft)r&s aAd phrase^dif f erent'iate 
'between' specific~^nd general s'eta.of^ 
words* and" identify the audi^fi^^.a 
prpse pasgage* ; — u 
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Written Expression Results , Grade Twelve 



% Illustrative items 



the *evei **-t.*r?*i eel»w *rt? in a 
»craaol*4 0: ^t. So-* of the* can 
be put to^c:r*c *o rake a slrxUe, 
unified pasa*rjp>>. Colore attest irxj 
to' answer any questions, read all of 
the sentences carefully. 

A 1 It probably received Its na»e 
Uom its ' 
t 2 copper-colored head, which is 
triangular 
3 In shape; 
• 4 Like the rattlesnake, it is a 

75 the pit vlpef family having a 
'hollow or 

* p}t between the eye and the 
nostril. 

C 7 The copperhead was once the nost 
cow a o n *, 

• and widely distributed of all 
venooous 

9 snakes in the United {states. 
D 10 This May be the reason that 
Democrats in 

11 the> North who syspathlze/l with 
the South r 

12 in the Civil War were called 
"copperheads,* . 

13 for they were suspected of 
treachery. 

B 14 Unlike the rattlesnake* it has 
no rattles ' . 

strikes without warning* * 
P l« Augustus Tho»>s* wrote a full " 
length drara 
17 that he called Th* Copperhead . 
C It Today, however, it 1% most 
frequently 4 
1* found • in sparsely settled areas • 

of the . , , 

20 South. 

t 

Which sentence* tost logically, follows 
Sentence C7jC 



o Sentence Ktfflp Senttac* £ 
o Sentence » «o Sentence 'G 

V — 



In the next lten, Part I expresses 
Ideas in choppy, repetit ioj^, sen- 
tences. Decide which sentence Part II 
expresses these sane ideas MOST • 
EFFECTIVELY. 

I* There were .some loose boards. They 
were laid on the railroad ties* 
They supplied a footing for the nan. 
They also supplied a footing lor 
his executioners*. ' 

II. o Laid on the railroad tics, the 
sun stood on sone loose boards 
which supplied a footing for 
hin and his executioners. « 

o Sooc loose boards laid on the 
railroad tics provided a footing 
for the nan and his executioners. 

o Sone loose boards laid on the - 
ties supporting the rails pro- 
vided a footing for'ts&c ran and 
his executioners. 

o On the railroad tie,s were sone 
loose boards, and they provided 
a footing for the nan and his 
executioners. , 



Sentence manipulation 



Paragraphs 



Identify the group of words which is 
incomplete or needs additional words 
to complete the .meaning*- • ^ 

o'. the barking dog in the" driveway, 
o It is humid. 
,o fceace continues. \ < * 

o ihere is the mail. * * 



Sentence recognition 



£>*♦ Henry J. Heimlich, • 

at Jewish Hospital in-Cincinnati, des- 
cribed the technique in the journal 
Boergency Medicine and invited • N 
physicians td t^ry it in real emor- < 
gencies. 

' ' * 

Which of the following terms is most 
respectful in the context of "the above" 
sentence? 

o director of surgery 

o chief blade « 

6 pra^titidner ; *■ , * 

o head doctor 



Language choices 



f * 



t ERJC 



* 



... * . . 



4 



Percent 


Total 


Correct 


Change 


'63.2 


,'• 40.9 


66.9 . 


-0- 


70.1 


+2»8 


44.6 


+1.7 


60.5 


+0.6 



^Written Expression Results, Graae Twelve 

r 

The percent correct scores for 1981-32 and the total changes in percent 
correct from 1975-76 to 1981^82 are shown below for the writing process skills 
^t&in-the dSttrve^ of: -Basic-Skills^ -Grade 12 r - r ' 



Written expression (total) 
language choices 
Sentence recognition 

Sentence manipulation 44.6 +1.7 /> 

. * .Paragraphs 

* * * . 

The members of the English Language Assessment Advisory Committee were 
pleased to see the sjcore increases inmost of the»writing process^ skills. 

. . • « • 

An examination of the trends in all skill area scores revealed that the 
skill areas showing the greatest tbtal increases over the years are sentence' 
recognition. (2.8 percent correct) and capitalization and punctuation (2.2 
percent correct). This pattern may reflect common instructional .practices, 
especially in light of the current emphasis on the basic skills. That is, the 
greater improvement in. capitalization and punctuation and sentence recognition, 
in contrast to the smaller gains * in language choices, sentence manipulation, and 
paragraphs *may reflect the. 1 . 'back to basics" emphasis and concern for conventions 
and correctness. , The members of the advisory committee concluded that while 
such skills as usage, word'forms, and capitalization are important supporting 
skills, greater attention should '^be devoted to the writing process skills — 
* language choices? sentence recognition^ .sentence manipulation, and paragraphs. 
The committee stressed that ♦skills instruction should not be overemphaVfsted at 
the expense of ,the total writing process and that skills should be taugtft as 
needed 'iVsuppprt .of writing. , t * - 

The co.mmi'ttee's instructional recommendations for grade twelve are presented 
* on/ the following' page. ■ <* ■ , 



Written Expression Results, Grade Twelve 



English Language Assessment Advisory Committee f s 
Instructional Recommendations for Grade Twelve * * - 



1. Writing instruction should include more writing, more teachingrof 
, writing, a greater variety of writing assignments, and adherence 
-to the principles set forth in 'the Handbook for planning an! Efjgg&ge 
Writing Jrogram . " „ *~ ■ 77 5 ~ 1 ~~ 

0 " *- 7 " ^ ^ ^i > ; ^ ^_ ■ 3 ^ - 

2.._ Writing should' be integrated with the' teaching, of reading in all ? ' 
content areas. . • * m 

i -^v- • " - • 

3. While studen^;afe -engaged in the act of writing, onfy;the process 
skills of wetting should be emphasized. Later, during the act of 
editing, the. supporting skills of writing should be. emphasized, a$„ ■ . 
the need' arises. . , ••-*':V^ j£ - 

4* Teachers should do tnore writing themselves", especially in the classroom 
with their students and on the topics ^they assign.* 

5. Various types of writing^activities and events (such as writing 
celebrations % writing showcases, write-athons, writing fairs, ^and 
writing$olympics) should^be planned and conducted to emphasize" the- 
importance of writing and to provide out-of -classroom audiences for 
the students. 1 writing. ^ • ' , " tf ^ 

£>. California Assessment Program results .as well as_assessments of 

students' wfitirig ^hoyld be'us&T ffcr .analyzing sfcffengthsa^nd weaknesses 
in students! writing and for setting goals. 



"Written." Egression Results, Grade Twelve 
Number of English Courses Taken 

* JLayghe IB 7feZ9 Annual Jteporfc, . data^vare presented^ OQ^the number of English . 
courses/takelt in high school by twelfth graders* At that time, 58 percent <5Tf 
the twelfth. graders reported taking four or more years of English, In 1981, the 
University of California established four years of high school English as an 

, entrance, requirement: for\incg>ming freshmen* n 

* v ^/'"wo . . — ^ 

Inl981-B2, grade twelve students were again asked to report the' number of 
English courses* they, would have completed from the beginning of ninth grade tit 
the end of the twelfth. 

* 

The percents of students taking one, two, three, and four years of English 
and their corresponding written expressioh test scores are, shown in Table 8 for 
1978-79 and 1981-82. ■> ' " ' - ' \ ' % * 

Table 8 

PERCENT OF TWELFTH GRADE STUDENTS AND THEIR WRITTEN EXPRESSION 
SCORES BY. YEARS OF ENGLISH TAKEN, 1978-79 AND 1981-82 





Percent of students ' 


Perfent correct score 


Years of 


Total 


Boys 


Girls 


Total 


Boys 


Girls 


English 


1978-79 


1981-82 


1978-79 


1981-82 


1978-79 


1981-82 


1978-79 


1981-82 


1978-79 


1981-82 


1978-79 


1981-82 


< 

One. 


0.7 


0.7 < 


0.8 


0.8. 


. 

as 


a7 


45.6 


45.9 


N 45.9 


46.1 


45.2 


45.6 


TVjo 


5.0 


.3.3 


5.4 


^3.8 ■ 


4.5 . 


2.8 


53.5 


50.7 


52.'6 


50.2 


54.8 


51.5 


• Three 


36.4* 


21.7 


37.1 


22.6 


35.7 

r 


,20.8 . 


59.9 


57.7 


58.7 


56.8 


61.2 


58.6 • 


. . i'out- or . „ 









___ 
















more 




72.4 


!&7~ 




59.3 


74.2 


65.0 


•65:9" 


~63.1T 


"64". 9 


"6&T" 


. 66.8 



The following conclusions are evident fron^thfc "data* in Table 8: 

.,..Almost three-fourths (72.4 -percent) of the "twelfth graders in 1981-82 
reported taking four or mote years of English, an increase of 14.4 pendent 
over California's. high schooi seniors o£ 1978-7 N 9., .J'/ ti 

Higher written expression scores were .directly associated with the nutter 
* of years of English students reported takiag. For exampl^, the highest 
scoring groupy which obtained an average sjbre.of 65. 9. percent correct, 
reported^ taking four, or more years of English. It must be hoted that these ' 
data fail to £how ,the strength of a causal relationship, since superior 
studenta a*g more likely to take, mare years of English. , 4 

«. * * 

- As* was t,rue in 1978-79, a higher percentafce^of girls (74. % percent) than - \ 
boys (70.7 percent) reposed .taking four >ears or more of English, and 
girl$. (with, an average score of 66.8 percenj corrfect)* continue to'outscore 
boyst (64*9 percent correct), on- the written expression teste.* * **" * ~ \ 

fable 9 shows the percentfc qf students taking one through tour or more 
years of fe&glish, by the educational, le^el dfvtheftr parents. * \ 
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Written Expression Results, Grade Twelve 



Table 9 



' .PERCENT OF TWELFTH GRADE STUDENTS AND THEIR WRITTEN EXPRESSION SCORES 
^BY YEARS. OF ENGLISH TAKEN AND PARENTAL EDUCATION,' 1978r?9 AND 1981-82 





Nohirfi 


school 


High school 


Seme college 




Fan* ' 


years 


Advanced degree 






KW9 


1! 




1978-79 


1981-82 


1978-79 


1981-82 


1978-79 


"*19Bl-82 


1978-79 


1981-82 


Mjmber .of 










































years or 












t 






























English 










































taken 
— 1 


X 


Scbre 


% 


Scbre 


X 


Score 


X 


Score 


X 


Score 


X 


Score 


X 


Score 


% 


Score 


% 


Score 


X 


Score 


i 


1 


35.0 


2 


42.1 


1 


47.3 


1 


44.4 


I 


48.2 


1 


51.2 


1 


45.7 


1 


49.5 


1 


59.5 


1 




2 


8 


45.6 


6 


45.8 


'7 


53.1 


5 


sa 0 


4 


57.1 


3 




3, 


54.6 


2 


53.8 


3 


Sl.6 


1 


5^ 

' X 


3 


40 


51.1 


30 


51.3 


43 


56.8 


28 


5&3 


38 


62.5 


23 


59.7 


31 


63.5 


16 


6a 9 


27 


66.0 


12 


62.0 


4+ 


51 


54.2 


62 


56.1 


49 


59.9 


66 


61.2 


57 


65.6 


73 


66.2 


65 


68.8 


81 


69.4 . 


69 


^ 

72.7 


£6 


72.2 n , 


Total 


51,9 


53.6 


57.?.. t 


58,9 


63.9 


64TI 


66.4 


( 


>7.4 • 


—t 

70.5 


' 1 


'0.5 
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' These data reveal the following; 



The tendency of twelfth graders to take four or more years of English Is ' 
asso^cl^ted with the degree of parental education. 

•Sizable' increases in the percents of students . taking four or more years of 
English since 1978-79 have occurred in all socioeconomic groupings (dkgres. 
of parental education being considered an indicator of socioeconomic 
status). This fact suggests that there is no 'reason to believe that the - 
increases are solely due to the* 1981- University of California system 
requirement. \ . ^ ' . * 



V. Mathematics Achievement for Grades three, 

Six, and Twelve 

^ L*_»^ _ ^ . V. - . . ^ 

^Synopsis of Findings .and Recommendations 
* * _* ♦ «<- 4 * 

* I^he jpring of 1981, California's third-grade students were assessed 
for the ^ second time in mathematics with the Survey of Basic Skills: Grade 3 , 

sixth-grade students were assessed for the sixth time with the Survey of 
Basic l&Ills; Grade 6 , In December of 1980*, the twelfth-grade students were 
'tested for the sixth time with tHe Survey of Basic Skills; Grade 12 . The 
following summary is based on tm» results. of the administration of the surveys 
and the special equating studies^ conducted to compare the achievement of 
California students with that of studgftts across themation. 

National Comparisons s ** 

On tte :^^^^gM^gj4gtg of Ba^ic -SkillVv \for^S^ normed in 1973, 
the typical California third gtade st^d^t ^ow* ranks at the 55th percentile, 
4*1 ..iro^r^ment of three percentile points over tlie 1980-81 ranking. Also, 
'on the ComgTrelifehsive"Tests ofTrasic Skills , ForA/S, normed in 1973, the 
typical California sixth grade student now ranks - at the 58th percentile, 
an improvement of* two percentile points over the 1980-81 ranking. On the 
Iowa Tests of Educational- Development , Form X-4, normed in 1962, the typical 
California twelfth^ grade student remains at the, 46th percentile; however, on 
the same test, normed irTl978, the typical California student ranks at the 
45th percentile, ,one point belofr last year. • f / ' . * ^ , ' * 

. ^ In grade three, the performance of students has been improving since the 
introduction of the mathematics* section in the third grade Survey. Over 
the three-year period ,£ron> ,1979-80 tp 1981-82, the ranking increase^ from £1 
♦to 55; the typical third grade student ranks five points above his or* her 
national, counterpart* _ Xn Jthe- sixth. grade T the performance of students has 
been improving steadily one ot two points each year since the introduction of 
the Survey in 1975-76. The typidal sixth grade student now ranks eight poirits 
above his or her national counterpart. A typical twelfth grade- student ioi 
California .ranked at the 44th percentile in 1975-76, the year the Survey was 
Ttrrt^Hlueed *IL the JtWeU th grade. Thfe ranging declined to. 43 in 1976-77 and 
rem^ineff steady throU]ghc^78-79. The ranking increased by pne* point in,- - , 
1979-80 and by two points ^ft^98&*ftl J ng^increase or decrease was recorded' 
in 1981-82* The_typi^aljKeij^h grade student stands four .points .below * . 
his. or fier national counterpartS© the publisher's norms. %- 

Longitudinal Survey Scores ' % •* 

• Scores on the Survey are also expressed as percent correct scores* m 
iTn^grade three, the typical California student^ answered 76.0 percetft &f»the, 
"questions correctly, an increase of 1.3 percent correct over tl\e. results of, 

1980*61. Thi^ increase. in Jscore wa^more than double the .increase in score 
from 1979 1 80 t& 1980-&1. In grade six^.the average studeiit scored 62.6 *per- 
A&tt correct." Since .this yl$t a completely revised versipn of totte Survey * 
Was administered, in the sixt^h grade, no \longitudinal data, on the new test are 
£vaila v ble. However, from thp administration of the olc? Survey to a sample 
of California students, t it was Jb^icated that^jpexc^t^cMrect^increased from 
^4nrri9B(^8rre& %1715^hts^e^ <4 Thrs7ear marked the greatest gafns^T " 
mathematics scdres of sixth graders since the inception of the sixth grade 



Synopsis q£ Findings, Mathematics " 

Survey in 1975-76* . In the twelfth grade, students gained 1.2 percent correct 
. from 1979-80 to 1980-81; however., Vrom 1?&0?81 to" 1981-82, the scares, of 

Skill Area Strengths/Improvements 

As in previous years, the members of the Mathematics Assessment Advisory 
Committee (see Appendix A) reviewed the >r£sults of the mathematics assessment 
for 1981-82. A summary of t the detailecr skill area strengths as judged by the 
committee members is presented in this chapter. 

- • . • ' 

At each grade level students, demonstrated a high level of mastery of com- 

— putational skills. In grade . three, almost all students demonstrated mastery 
of basic number facts; in grade six, almost all students performed simple 
computations involving* addition, subtraction, and multiplication; and in grade 
twelve a great majority of students correctly performed basic operations on 
whole 'numbers. <>%± % 

• * * * 

* The sixth and twelfth grade students had some difficulty in performing 

long division;' however, the scores on long division questions are Steadily 

'improving* Another skill that showed a strortg steady growth pattern was 

decimal computation.* , m 

As for noncomputational skills, students in grade* three, six, and twelve; 
did very well on recognition t$sks and on tasks that students generally encpun-, 
ter putsi'de the school. Such tasks include recognition of simple geometric 
figures; linear measurement such 4s with a ruler; measurement of time and, 
- temperature; and the reading of simple bar graphs. ' , ~ 

„ Students in grades ■ three, six, and twelve also showed better under- ^ 
standing of geometric terms ,and concepts, perhaps indicating some Use of 

proveftient in measurement concepts such as perimeter and area and conversion 
within a system of units. Scores ^in grades six and twelve also improved on * 
qjgestioiis related to the Pythagorean ^relationships. 



'Skill Area Weaknesses. 



1 & 



* v The Mathem&fics Assessment Advisory Committee identified at each gtade 
level tho- skill areas in which, stycfegts were weak .arid that require more* 
emphasis in the cIassrooms*^s§r$as in need of improvement are listed separately 
/for each "grade level later «ia'cRM^h«t>ter« ■ x * 




Generally ^ students at al^/jgrade levels were found, to be weak in multi- 
plication with numbers involving zeros, such as 10 Or 100« In grades thre.e 
and six, place value and subtraction witt^ regrouping, especially involving an 
^internal zero,* were Weak at£as. in grades six and twelve, students had 
'difficulty working with decimals becausa„o£ tlieir lack of understanding of 
place va,lUe. Third, graders were also weak in solving word problems.' that; 
Involved multiplication of' two or three number's, and' sixth arid twelfth grade' 
students were generally 'weak in solving two-stpp word, problems. 



\ \* ,± J* ^ ^ 



mo 



Synopsis 'of Findings, Mathematics 



In geometry and measurement',, students were .weak in areas that required 
_ ektima t ion in, r jtfe pxoce£s „of answexingJ 

/a question; Th measurement, students at ^all^gfcade levels were found to have 
moxre difficulty with the metric , sy^te^" than with the U.S. Customary system of 
measurements z ° ** ' . v * : , m 

< Differences! in ^Mathematics Performance, by, Sex , / 

9 " 

Differences %vt mathematics performance of girls and boys have been studied 
by the Mathematics Assessment Advisory Committee. The .initial findings of the 
commi t tee. wiere first reported in 197JMJ0; the committee cdntlnues to explore 
why suchydif faiences exist. • * , ✓ 

Of the 13 skills involving computations, applications, and problem 
solving, girls surpassed boys on eight in the third graded whereas of the * 
15 skills $t grad& six, girls surpassed boys on four. One surprising result 
found in this year's analysis of datS is that although boys„ scored higher 
than grrls in application problems, t girls, surpassed boys in questions on \> 
^jay>blem analysis. Such questions ask students to identify relevant informar 
tion in a problem, to estimate the sizfe of an answer, and 4 to* identify the 
appropriate mathematical mod$l. The committee members felt that girls have 
developed t better problem solving skills but that they are not. applying these 
, skills on application questions'* K ^ 

• ' > ' ' ' ' * ' 

flfofe Commi ttee's Reconjmendatians - ' ' . . 

• f * a „ \ '''*".* 

, The Mathematics Assessment Advisory Committee made g£n6ral recommenda- 
tions on the basis of its analysis of the mathematics results for grades* \ 
three, six, and twelve. The committee. 1 s general recommendations are as 
follows; • " *' J'\ , /' -* 



"The use bf .manipulative^ anft models should, be increased to facilitate 
student % h understanding of place value concepts and <0b help^tKem 
develoi/ special visualization skills in tvro and three dimensions., . 

At f alfl grade levels^ mojce instructional tnlme should be spent on* ' t , 
learning to re&gnl^e cues fpr selecting correct operations . in * 
application questions (as recommended in the addendum to the Mathe- 
matics Framework , 1982), rather than more drill and practice on % ' 
computational skills. Although drill and practice" on basic com'pip \i 
tational skills remain, importapt, such techniques should be balanced 
with the development of skills in problem solving* \ ' \ 

Teachers and developers of Instructional materials should strive to 
use those materials that; help;. students- at >all ablHty levels £o 
develop skills, in pijobltsd analysis and mbdeling. (as recommenced in 
the atfdendum' to the Mathematics Framework , 1982). This kind of 
instructional emphasis* will, not detract 4 from the 'development of otfyer 
skills but, in facit, should ^Improve .computation a t nd application skills 
by giving, students a clearer understanding of the^ mathematical pro- 
'cesses involved/ dti. pirobleto, solving* *' \ .* , / * , ' 



al 



Synopsis of Findings, Mathematics 



Teachers ^shOMldT be provided with in-service training and with instruc- 
tional materials that will aid them in .helping students model and 

6?xatjpies or Suggestions that will help teachers involve ^students in 
classroom activities, that lead to opportunities for students to*creatj 
and solve '"real* multiple-step problems. ' , 

It is important ttefc^eachers and curriculum personnel avoid imbal- 
ances in the curricultlt** Some of the -qite^'tions that might be asked 1 
in the planning of a s trbi^r ^hg g^tics curriculum are the following-: 

.-..Are, the needs of'advance4 spuden^s in algebra, geometry, trigo- 
nometry f and calculus being me^as well as the needs of students 
who require additional instruction i»n basic mathematics? 

• - * J * 

- Are "ehd-ofTthe-book" topics systematicalltfSincluded and articu- ' 
lated across grade levels? " - 

* if 1 

- Are new textbooks bfelng chosen that offer a vatiety of problem J , ^ 
, analysis techniques .at all "levels? " \ \ / 

- Is problem solving used for motivation And integration of mathe- t . 
• matics into' "daily-life, mathematics " skills?" 

t* Is problem-solving instruction integrated with skill instruction 
rather than being delayed until complete student mastery is attained 
- in computational skill? . ' * ; s * 

- Does .Instruction*, in measurement include actual situations, in whLch 
all students participate' actively in taking' measurements? 

floes the curriculum ^include the use of calculators and computer 
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Mathematics Test Results for Grade Three 



Test Scope 



The Survey of gasic Skills: Gjrade 3 was developed to assas* 
of mathematics skills of , third grade students in Calif ornia. ^ Tt<< 



the Survey Vere designed £o assess students 
tic (counting and place value, ^nature of nt 
tions), gepmetry, measurement, patterns ahi 
models. In eacfr area, with the exception J 
the test items include computational skills 
wellas word* problems. 'Figure 23 illustraj 
skill area in the total test; 



s the levels 
<e'360 items on 
skills in the area # of arithme- 
bers and properties, and opera- 
graphs, and problem analysis and , 

problem analyses and models, 
f and knowledge of terminology as 
s the emphasis placed on each , 



The emphasis on each skill area in ttfe third grade Survey is consistent 
with the mathematics curriculum of most California scbooLs- and additionally m 
reflects the "umbrella''' concept of 'problem solving/applications 'emphasized 



Counting and 
place vaioc 



Problem analysis 
and -models 




Patterns and graphs 



Measurement 



Geometry 



Nature of 
numbers and 
properties 



/. 



Fig 23 dumber of questions, by sKiU area, in ttie mathematics section of the Survey of Baste Skills. Grade 3 
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Mathematics Results, Grade Three 
the Mathematics- Framework and the 1980 Addendum for California Public 



Schools; Kindergarten through Grade Twelve . In the new framework, the 
problem s.olving/appli-cations, rather than being a separate strand, is now 
"positioned" to receive equal emphasis with each of* the other strands of 
mathematics. Figure 24 shows the major content categories of mathematics 
recommended- in the 1980 addendum, including the problem solving/application 

> ♦ . 
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Fig. 24. Probtem solving/applica- 
tions, the umbrella for all 
strands in mathematics 

* 

skills. The third grade survey assesses all the skills proposed in the . 
addendum at the third grade' level except the skills on calculator/computer. 
A detailed description of the skills assessed' in the third grade survey ( \is 
given in Survey of .Basic Skills; Grade 6— R ationale and Content. 



Mathematics Results for Grade Three 

• * 
>he results of the third grade mathematics assessment for 1981-82 'are 
shown in Table 10. This was the third year of the assessment in mathematics 
ill grade three. Longitudinal comparisons at* also given in Table 10 for the 
three-year period (1979-80 through 1.981-82). 

» 

As shown in Table 10, the average California third grade student in l( 
1981-82 correctly answered 76.4* percent of the questions in arithmetic skills 
.7J6.6 percent in geometry 74.6 percent in measurement; 75.9 percent in pat- 
terns'and graphs; 71.2 percent in problem analysis and models;- and 73.2 
percent in problem solving/applications. Overall, the average third grade 
student correctly answered" 76.0 percent of the mathematics questions.' 

t ■ 

The following conclusions can be drawn about the 1981-82 mathematics 
performance of California- third grade students: - 

The typical third grade 'student in California was able to answer 
over thlree-fourths of the 'test questions correctly. . " , 

* The average percent correct scores increased in all ma jor^ubskill 
areas over those recorded in 1980-81. \> • \ 



Mathematics Results, Grade Three 
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Table 10 



Mathematics Scores of California Third Grede Students and Changes in Mean 
Scores on the Survey t>rBasic. Skills^ Grgde 3< 1979-80 through 1981-82 



Sk ill * fpa 
' ' ■ " ^ t. 


Number of 
Questions 


Mean score, 
by year- 


Change 


1979-80 

0 


1980-81 


198r-82 


1979- 80 
to 

1980- 81 


1980- 81 
to 

1981- 82 


f MATHEMATICS/ TOTAL 


360 


74. i 


, 74 .-7 


76.0 


+0.6' 


+*1.*3 


Arithmetic 

Counting and place value 
Skills 

Applications 


i 

245 
45 
30 
15 


74.5 : 

79.3, 
79/7 
78.,5 


75.1 
79.9 
, 80.3 ' 
*79.1 


■ 76.4- 

81.9 
80.3 


+0.6 
+0*6 


+1/3 . 

4*1» \ 
» J/. 4 

• +1.6 \ 
+1.2 * 


Operations ' 

,Basip* facts 

'Addition 
\ Subtraction * 

* *u j* uj. pilva u ion 

Application . - 
Basic facts 
Addition/subtraction 

Mill tiDl ira H nn 

> 


155 ■ 
25 

30 ' 
"30 
30 
40 
13 . 
15 
12 


■".752.7- 

85.9 . 
-82.6 

69.9 

63.7 - 

65.7 

68.0 

75~>flL 

51.4 - 


73.3 

86.3 
, 83.4 ■ 
. 71.0 

64.5 

65.9 

67-. 9 

76.0 . 
w 51.2 ' 


74.8 

84.7 

73.1' 

66.7 

66.7 

68.6 

77.4' 

51.2 * 


+0.8 . 

■ +1.1 

+0.8 
+0.2 
-0.1 
+1.0 
-0.2 


+1:5 . 

4.1 O 

+r.3 

► +2.1 4 

+212 , 

+0 ft 
^•0.7 ( 
+1.4 / 


r 

Kature of numbers find properties 
Properties , and relationships 
Money a*id fractions 

ADDlica t* innc \ * 


45 
15 
* 15 % 

v 15 


75.8 

76.0 - 
80.2 

71.1 . 


• 7,6 . 3 
,7*6.4 

• 81.1 
J71.5 

75.1 
76.3 
' 72.8 - 


f 

~ 77.?* 
77.5 
82„4 . 
7"2.2- 

• 


+0 5 
' +0.4 
> +0.9' ' 
+C4 


4-1 1 

+1.1 
+1.3 
+0.7 


Geomebry • 
Skills 

Applications ' 
f 

* * 


30 
20 
10 


74.9 
7 6. .3 
72.0 


76.6 
. 77.7 
74.3 


+0.2 

,-o- 

+0.8 


. +1.5 
+1.4 
+1.5 


Measurement 

Linear measures 
Other measures ^ 
Applications ' 


, 15^ * 
15 
10 


73.4 . 
69.7 
78.4 
71.4 


74.0 
70.6 
.' 7B.6 
72.. 2*. 


74.6 ' 
72.0 
78.3 
72.8 . 


+0.6 
+0.9 
+0.2 
+0.8 


• +0;6 

-0.3 
+0.6 


Patterns and graphs; 
Skills 

Applications 

* 1 


30 

• * 

15 
15 


73.8 
63.5. 
84.1 


74.6 
64.1 
85.0^ 


.75.9 
65.7 
86.2 


+t).8 . 

* 

+0.6 * 
+0.9* 


+1.3 
+1.6 
+1.2 


t^roblem analysis and models 


* - 15 i 
* • * . *v 


70.1 


70.5 


71.2 


+0.4 ' 


+0.7 


Problem solving/applications* 


120 ' 


71.5 


'•72'. 3 , 


. 73^2* 


> 

+0.8 


+0.9 



Questions in this category are an aggregate of 105 application questions and 15 questions 
in problem' analysis an$ 'models^ , * • ' 
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Mathema tiers Results, Grade Three 



* , • * * » i 

The highest percent correct score was in operations using basic 
facts (87.5 percent correct), followed closely by applications with 
graphs (86.2 percent* correct), addition operations (84,7 percent 
correct), and money and fraction problems (82.4' percent correct). 



Summary of the Committee 1 ^Conclusions 

The members of the Mathematics Assessment Advisory Committee reviewed the 
results of the third grade students by skill areas and by items within each 
skill area. This committee was instrumental in determining the scope of the 
assessment and i'n selecting the 'test questions. The names of the committee 
members appear in Appendix A. The pommittee members made the following 
general remarks about the performance of third grade students in California 

public schools. ^ 

»» * 

. The committee members were unanimous in their praise of the perform- 
ance of the third grade students, especially the pattern of gjdwth 
v in mathematics scores from 1979-80 through 198J-82. 

. Teachers and students 'should be particularly commended for the 
strong performance and growth shown in mathematics scores over the 
three-year period. 

'. The strong performance in all ma'Spr skill areas indicated to the 
'committee members that a strong, comprehensive mathematics instruc- , 
tional program exists in kindergarten through grade three, in Cali- 
fornia public schqpls. , 

The committee members also "identified areas of strength or improvement 
and, areas in need of improvement. The .areas of, /'strength included those skills 
in which students achieved at the committee'-s level of expectation. The 
areas of improvement included those skills in,. which -student performance was 
at a level below the committee V expectation but on which the improved L , 
scores led the* committee to believe that tea'chers are placing the desired 
emphasis.' The areas in need of improvement. included th« skills that the 
committee members would like fo have particularly emphasized in California • 
classrooms* - 



Areas of Strength or Improvement . 

• 'Identifying ordinal positions (e. g. ,, s,econd, Jrh'ird, and so on) 
.. of familiajr -objects ' v : 

• Counting by Is, 2s, S*f and 10s , ' . v 

' * Identification of the place value of a given digit, especially- 

zero, 'In a numeral , "' > « » ' • u , 

. . Identification of the digit of -a. given -place .value, in a . •» . 

numeral ' - ' * . 

' • Recognition of numerical values of written nurae.ra.ls • 
' • Addition; subtraction, multiplication* and division- facts . 
m Word problems involving .money ' ; 

• Recognition of geometric,, ; terms and concepts' ^ 
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Areas of Strength or Improvement (cont^) 



• Recognition of simple geometric figures 

jL Location of points on a coordinate grid ^ 

• Linear measure (nonstandard units) 

• Linear measure (U.S. Customary units). 

• Perimeter and area of geometric figures 

• Measures of time (cl&ck *and calendar) 

• Measures of temperature f 

• Reading of a bar graph 

• Reading of a pictograph (especially those involving coins) 
Applications involving reading of graphs 
Recognition of a function rule 
Problem analysis 



Areas in Need oi Improvement 

• Identification of odd or even numbers 

• Multiplication involving numbers with zeros 

• Subtraction of whole ^numbets, especially those with internal 

zeros 1 or unseen zeros ^ 

• Multiplication vof three whole numbers 

• Word problems involving multiplication by 10 and 100 

• Knowledge of the metric system 

• Understanding of the concepts involved in determining the 

volume of an object ^ 

• Recognition of line segments . 

• Recognition of* the diameter of a circle 
o Linear measure (inetric units) 

• Estimation of measures of mass 

• Applications involving, measures of temperature 

• Recognition of number patterns involving doubling 

• Recognition of missing elements in geometric patterns 

• 1 Applications, using basic facts • 

• Applications .involying multiplication of whole numbers 



* 

The Cfrmmit tee's Recommendations 

The members of" the Mathematics Assessment Advisory 'Co&mittee made trie 

following' recommendations for the improvement of mathematics skills in the 

third grade. / , • * . 

... t » t 

• The current emphasis in place value be continued because this concept 
is the key^o th^ understanding' of arithmetic op'ei;ations, especially 
when students confront renaming in their mathematics fcurriculum. 

• ^ Students ne!&d more practice in reading mathematics problems for more 

complete comprehension. • , 
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• Instructional emphasis should be placed in giving students experi- 
ences to help them discriminate between standard units of length, 
volume, mass, and ^temperature and to know when to apply them in the 
measurement of , same "common object or quantity. 

• In subtraction operations, the most .common error ma^de by students was 
subtracting the smaller digit from the larger 'digit regardless » of 
the positions of the two digits in the problem. More instructional 

, emphasis phpuld be given to developing understanding of the subtrac- 
tion algorithm, with, renaming, .through the use of manipulative mate- 
rials, and to developing skills in* its usue. r 

? ,: • 

• In application questions the most common error made by students was 
to add the numbers in the problem even though the operations called 
for were either subtraction or multiplication. The committee recomr 
mends that students be confronted with many sets of application 
problems that randomly involve all four of the basic operations and 
that greater 'instructional emphasis be given tb the selection and 
use of the' correct operation err operations. . ( 

• Instructional emphasis should be placed oil, relating multiplication 
skills to real-life applications from an early point in . instruction^ 

i r ' * 

• The current test results indicate -that teachers now offer a compre- 
hensive instructional program in mathematics iti kindergarten through 
grade three. The cowiittee strongly recommends that this broad 
instructional emphasis be continued to ensure steady improvement in 
all mathematical skills and concepts. ^ 

Some Examples and Ideas for Classroom Teachers ' 

Presenting computational problems in other than vertical format 

• Introducing completed problems with portions missing to force^stu- i 
dents to think 'about arithmetic algorithms 

• Asking Students to discuss together the steps involved ir\ solving a 
variety of problems * t { 

• Giving students completed problem sets, rtith errors hidden in the 
computation shown, and asking for identification and explanation of 
the 'errors , 

• Givirig students experiences, oral and written, using "100 more 

* than/* "100 less than," and similar phrases for ot^er decimal values 

• Providing students with opportunities to identify incorrect, answers 
and to tell why they are wrong, especially positional, errors 

# 

• Demonstrating to students that subtraction allows renaming by ■ 10s , 
100s, etc., but addition oi several number^ allows renaming by mul- 

- tipled of 10s, 10bs, etc. 

• . / 

t 
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• Using plkce value boards and manipulatives to clarify for students 
the positional difference between addition, in which both numbers 
are represented, and subtraction, in which # or>ly the minuend is 
represented . 

• Using calculators to develop estimation, rounding, and place value 
skilly ' * • * 



r 



The Coxwnittee' , s Analysis of Skill Area Results 



The members of th,e Mathematics Assessment Advisory Committee reviewed 
the results of the third grade students by skill area* and 'by items within 
each skill area. The committee members jucfged th^ adequacy of student per- 
formance in ligfyt of the difficulty levels of the questions and the relative 
instructional emphasis of each skill in the typical classroom. 

The results of the committee's analysis are surrmnarized-'below in' two 
categories — computational skills and problem solving/applications skills. 
The computational skills are described under two headings — "Arithmetic, 
Numbers, and Ope rat ion's ;" and "Geometry, Measurement, and Patterns and* 
Graphs." In the following discussior>s only the- areas of special strengths 
or weaknesses are described; no- attempt is made to discuss each skill tested 
on the Suryey . The purpose of the illustrative examples is <£o indicate the 
relative strength or weakness in the skills? hence, students' performance on 
illustrative items should not be taken as indicative of their performance in 
the # entire skill area. ■ » ■ . 

* * ' * ' 

^ * * i » 

Arithmetic, Numbers, and Operations »■ , 




The mdin 'Skills included under this category are counting and place value, 
nature of numbers and properties, and operations. The subskills include the 

fQllowing: ordinal positions ; .counting by Is, 
- ,2s, 5s, 10s, or 100s; reading and writing 
numbers; finding place values;- using commuta- 
tive and associative? properties; Multiplying 
v a number by zero; using symbols for greater 
than, less than, and equ&l to; recognizing 
.even and odd nurtberS; knowing basic f^cts; 
and performing operations of addition, sub- 
traction, and multiplication on whole numbers. 



As shown in Table 10, third .gracje students continued, to show improvement 
in the arithmetic skills dt counting and place value, nature of numbers and 
properties, and operations. Not only was the total average percent correct 
for arithmetic higher in 1981-82, but also the score for every item increased. 



i Mathematics .Results r tirade Thr*ee * • 

J' 

Of' the 190 computational items in arithmetic, th^ scores on three items* 
remained the same and decreased only on three. Third grade students 
spored highest in basic facts (87.5 percent correct) and lowest in multi- , 
plication (66.7 percent correct); however; third grade students' greatest', 
improvement (2.2 percent correct) from 1980-81 to 1981-62 was in multipli- 
cation/ 



In counting and place value skills, the committee frelt that students' 
ha^e a good understanding of the concepts in' general. On items that directly 
test understanding of piace Value, such as pictorial representation, expanded 
notation, and identification of digits in the ones, tens, and hundreds 
place, students showed good improvement. However, the committee members 
expressed a need fo'r stronger reinforcement of skills in place value for 
all students at, this* grade* level, because this concept is the key to under- 
standing arithmetic operations, especially renaming as, students ' progress 
in their mathematics curricula. The following example illustrates that 18 
percent" of> tre A $students were unable to identify the place vaftie of # the 
numbers- 34^y .fJ 




13 O 

3 O 

. 2 O 

82 % 



345 = • 

3+ 4 +.5 
400 + 30 + 5 
400 + 50 + 3 
300 + 40 + 5 



ttt£ 'confcittee members also found evidence that place value concept 
cont£x^.d: to'be ( .a weakness for some students at the sixth gratfe level (see 
the : ,pik<jfe>value section for grade six). ^ 



In 6pet£tions, the committee members observed that students appear to 
understand Wth the horizontal and vertical forms of addition, subtraction, 
and multiplication .facts. Also, they felt that division- facts are being 
taught and learned by the end^of the third grade. 

|i\ibgeriitions skills, the committee members recognized that, although 
aiiditiitm^atid'" subtraction skills are considered to be at the mastery level, 
multiplication- is considered to be at the' developmental level. Thus, the 
committee membets feft that good instruction, is being provided in computa- 
tional fekillf arid that student learning, is adequate. 
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/ 

The committee members noted certain frequent errors by> students in the 
computational skills.' For example* in the following addition problem, 13' 
percent of the students selected 723 , which is arrived at by juxtaposition 
of the numbers ^instead of .reifeming. ** ( 



13 
15 
CI 
11 



39 
+ 49 



73 
83 
93 
723 



Failure to renane from ones to tens 
and £rora tens to hundreds 



^fciilur* to roruina frora ones to 
hundreds • * 



Also, nine percent selected 83, which is the result of renaming or 
"carrying" a ten instead of twenty or, two tens. Perhaps these students 
confuted arddition renaming with subtraction renaming, which allows only ^. 
tens to be "borrowed." '.In subtraction problems involving renaming, some 
students simply subtracted the smaller digit from the larger digit regard- 
less of their position in the problem. 

\ . * * 

The following Subtraction question* appears on botfi the third grade* and 
sixth grade tests. As can be, seen from the students 1 responses, most sixth 
gr<ade students have learned, to avoid/positional valu6 mistakes. 



2)0 
i 162 



0158 
C 152 
58 
• 48 



Grade 
Three 
11 o 
28 • 
10 
~-5l 



Grade 
Six 
2 
4 
5 

19 - 



Response \ . 
Characteristics 

Failure to doKo hundreds and tens 
Positional value "5«rrjp^cd 
Failure, to roname ten* or positional 
value ignored for tens , 



The following example shows students' .performance in a multiplication 
problem. The i pattern of errors, shows a lack of understanding of 'place value 
by a large number of students: • v ' , „ v 



13 
15 
41 
11 



o 
o 

o 



67 
x 3 

81 
181 
201 
1821 



Response Characteristics 

Failure to renaite fron >nc3 to tens and 

£fo» ten? to hundr*\»r. <> • 

Failure to ronane frvn or>*s to tens 

Correct answer 

Juxtaposition of products 18 and ( 21 



4 • • 
I 



On r itenfs involving ^SuTt^plication by 10 or 100, the most common 'error , - 
made by students. was adding rather than multiplying. Tha committee^uspected 
that this *error was due to the fact that some students have been told to add 
zeros,, to find the answer to multiplication problems involving 10 or 100. 
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0 

Geometry, Measurement, and flattern^and Graphs 

The questions in geometry cover skills in identifying basic geometrical 
shapes, parallel lines, line segments, right angles, diagonals of quadri- 
laterals, diameters of circles, amd congruent figures^ The questions in 
j & ' measurement deal with skills in measuring 

objects, converting units ^finding appro- 
priate units, 1 and determining the perimeter 
and area of^ a polygon. Tt^ Skills also 
include identifying correct ^ime, order of 
djtfs of the week, and months of the year; 
redding a calendar and thermometer; deter- 
mining volume; and finding tjhe heavier of 
two measures. The questions in patterns and 
graphs require skills in identifying *the 
function rule, completing a function table, Q 
and identifying a geometric or number * pattern 




From Table 10, it is apparent that from 1980-81 to 1981-82, scores . 1 
increased in all skills under geometry*, measurement, and patterns and graphs 
e'xcept for tlie scores in "Other" (nonlinear) measures. The questions und^r 
the nonlinear measure require students to find the volume of pictured cubes 
and find the „ temperature in k pictured thermometer. # 

In, geometry,* the committee felt that*students afe doing an excellent job 
of recognizing and selecting c6mmon two-dimensional geometric figures. The- 
committee, however, observed that students seen\ to have difficulty recogniz- 
ing and/or identifying simple geometric components, such as parallel ftnes, 
diagonals, right ""angles, and diameters. 1 ^ 

la measurement, the, commit tee members aeted that students continue to 
have greater difficulty with the metric system than with the U.S. Customary 
system of measurement. The members surmised that instruction in measurement 
skills is perhaps not too well developed at the third grade level; however, 
the scores do indicate that ijjore and more instructional programs include 
metrics. In questions on counting the number of cubes (see the following 
example), the committee noted that most erVors resulted from students* coun- 
ting the visible faces of the cube rather than, all the cubes: < , 




102 



M), 



V 



-'Mathematics Results, Grade three 



With regard to scores on itiems on temperature, volume, pr mass, the^ 
committee felt* that the levfel of performance of third grade students is 
adequate. However, the committee members expressed concern over the decline 
in scores, in this skill, ]th£ only skivll on the entire test for which scores 
declined-from 1980-81 to 19M-82. Th<e, committee recommended that increased- 
instructional emphasis be given to teaching students to discriminate between 
standard unit's of length, volume, mass, and temperature and to know when ! to 
apply them -in the measurement of som£ common object or quantity. * 



'Problem Solving/Application 



The 
all the s 




third grade Survey includes word problems or application* questions in 
kills of counting, andf place value, nature of numoers and properties, 

operations, geometry, measurement, and patterns 
and graphs. The application questions require 
the use of ( a skill, such as subtraction, to 
i solve a word problem presented in daily life 
context. The test also, includes questions in 
analysis and model's (problem solving). ] In 
these 'questions the emphasis is not on' finding 
.correct numerical solution, rather* the emphasis 
.is on analyzing a -word problem and finding % 
ts, irfissing information, or the question being as,k$d. Some questions 
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given fac 

require^ students to match a picture model with a mathematical sentence Or 
statement. * v 



Applications 1 * % 

In application questions involving basic facts and addition, the com- 
mittee felt that students had good understanding of these skills. The 
committee hoted some areas of difficulty^ however. In application prgfclgRts^ 
students often chose an addition answer when subtraction or multiplication \ 
was^he indicated operation.. In'a question on subtraction facts, 9(|.8' percerrjt 
oif the \students knew^that 15 - 8 = 7, but only 72.0 percent were abl^ to usej 
tKis fact correctly in a story problem. The answer found by adding tf&g^t}^ 
the* numbers in the problem was selected by 16.2 percent of~the students. * < 



In the construction of the third grade Survey , 33 application items were 
designed to be paired with computation or* concept items. These application 
itfcms involve the same numbers and the same operations as the paired skill 
items. The average percent correct on the skills items in 1981-82 was 74.1, 
while the 1 average percent correction the paired application items was^ 69.1. 



/ 
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The two* examples below show matched skills and application items involving 
multiplication.. The percent of students who chose to adcl was four times as 
greatin the application item as in 1 the skill item. 



•23 

x 3 

* O 20 

* O 26 

•« • 69 



Brown School had 3 rooms 

Each room had 23 students * 

How many students were at the school 9 

«,0 20 

4Q O 26 

« O 68 

52 # 69' . 



Although 'th£ . committee members noted growth in multiplication applica- 
tions, they felt that scores in multiplication applications seriously lag 
the scores in other areas. The pqminittee recommended that instructional - 
'emphasis be placed on relating multiplication* skills to real-life applica- 
tions as* early, a^ possible' in the instructional program. * 



Problem Solving - ^ 

The t;hird grade Survey includes 15 questions in, analysis and models. 
The average percent correct sc'or^ in 1981-82 was 71.2 which yas an increase 
of 0.7 percent 9orrect ovdr the* 1980-81 score. The following question illus- 
trates tfte typical performance of the third grade students in selecting an 
appropriate mathematical model. 



The bus went 20 miies 
Then it went 12 m»tes 
« . How many miles in all? 

How do^you find the ans.ver' 5 

9 O 32-12-20 

1 O go *' 12 = 240- 

< O 20- 12 = 8 

M • 20 + 12 * 32 



ifne toembei^s of the advisory committee felt that the performance of the 
students on questions in analysis an4 models, was good, particularly in light 
of tqge . fact thai? regular instruction" in these skills apparently does not take 
place^ The committee members strongly recommended* that more instruction be 
given tWe^denta^)f all ability levels in the skills of, problem analysis 
and modelling. # ^fflls instructional emphasis should not detract from the * 
development of other skills, .but in fact, should help improve application 
and computation skills by giving students a clearer understanding of the 
mathematical processes involved in problem solving. , 

/ 
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Test Scope 



Mathematics Results for. Grade Sik 



The new Survey of Basic Skills: Grade 6 was developed to replace the grade 
. six Survey first given in 1975-76. It assesses the levels o,f mathematical 
skills of sixth grade students in California .on a more comprehensive set of 
subskills' and is .similar in breadth to the new Survey, of Basic Skills: Grade 3 , 
which was* first uged in 1979-80. The development and review process that 
spanned a period of two aqd a half years ^included a large number of Califor- 
nia teachers, students, and schools. The result of this process was a com- 
prehensive set of test specifications and the 48,0 items that appear^ on* the 
' Survey . 



Counting, numeration, 
and place value 



Problem solving 



Nature of numbers 
and properties 



Operations 




Tables, grap ( hs, and 
integrated applications 
s ■ 



Probability and statistics 



Measurement 



Expressions, equations, and 
coordinate graphs 

Fig. 25 . Number of qiMst^ons, by skill area, irt the mathematics section of the Survey of Basic Skills, Graded 

♦ 

« * * ' 

The 480 items on the Survey were designed to assllls students 1 skills in the 
area of counting, numeration, and place value; nature of lumbers a$d properties; 
operations; expressions, equations, and coordinate graphs; geometi^; measurement; 
probability and statistics; table's^ graphs, and integrated applications; and 
problem solving. Figure 25 illustrates the emphasis placed on each skill arjea in 
the totaL test. The emphasis on each skill area in the test is consistent with 

'.*>■'.'• • • ' • ^ 
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Mathematics Results, Grade Six 



the mathematics curriculum of most California public schools anci addition- 
ally reflects the "umbrella" concept of problem solving/applications emphasized 
in the Mathematics Framework* and the 1980 Addendum for California Public Schools : 
Kindergarten through Grade Twelve , In the new framework, problem solving/ 
applications, rather than being a separate strand, receives equal emphasis with 
each of the otjier strands of mathematics. Figure/26 shows the major content 
categories of mathematics recommended in the I9$v addendum and the "positioning" 




13 



Fig. 26. Problem solving/applica- 
tions, the umbrella for all 
strands in mathematics 



of the problem solving/application skills. The sixth grade Survey assesses all 
the ^ i lis proposed in the addendum, except, fqr^ the calculator/comj^ter ski^s. ^ 
A detailed description. of the skills assessed in the sixth grade Survey is 
given in Survey of Basic Skills: Grade 6 — Rationale and Content * 

« % j ■ 

Mathematics Results for Grade Six 

The results of the new sixth grade mathematics assessment* fpr 1981-82 Are 
shown in Table 11. Since f.or 1981-82 the test was completely revised, long- ' 
itudinal comparisons are not made between this year's scores and previous 
years 1 scores. However, the results from the administration of the old Survey 
to a sample of Calffornia students indicated that percent correct score increased 
frpm 60'.4 in 1980-81 to 61.6 in 1981-82, an increase of 1.2 percent correct. 
The scores on the new Survey for this year will serve as a baseline for comparing 
the gkill-by-skill results in subsequent ye^rs. TaMe 11 provides an initial 
profile o£. statewide student performance in Califort^a. 
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Mathematics Results, Grade* Six 

* <♦ 

Table 11 * , 

Mathematics Scores. of California Sixth Grade Students 
on the Survey of Basic Skills: Grade 6 



Skill Area 



Number of 
questions 



Average percent 
correct* 
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MATHEMATICS, TOTAL 

Counting,, numecatibn, and, place value 
Skills 

Counting and numeration , 
Place value * i * 

% .Applications 

Nature of numbers and properties ' 
Skills 

Ordering and properties 
Classification of numbers 
Applications v 4 " . 

Operations 
4 Skills . ' 

Addition/subtraction of whole numbers 
Multiplication of .whole numbers 
^Division v of whole numbers 
^Addition/subtraction of decimals 
Multiplication/division of decimals 
Operations on fractions ! 
£ercents and equivalent fractipns/decimals 
Applications 

One-step involving whole numbers 
One-step involving^ rational numbers 
Two- (or more) steps ■ 
Expressions, equations, and coordinate gtaphs 
Skills 

Expressions* and equations 

Graphs and function tables 
Applications 
Geometry % ' < ^ 

Skill? * 

Shapes and terminology 

Relationships 
Applications 
Measurement 
Skills 

Metric units 

U.S. Customary units 
, Length, area, ( and volume 
Applications » " ' 

Probability ,and Statistics 
Probability' * 
Statistics 

Tables, graphs, and integrated applications 
Tables and graphs ' > 

i Integrated applications \ 

Problem solving > • j , 

Formulation - 
Analysis and' strategy 1 

Interpretation 

Sdluti'on of problems 

_ ^ __ _ 



480 

40 
25 
15 
-10 
15 
50 
35 
15 
20 
15 
145 
98 
15 
14 
15 
14 
-13 
15 
12 
47 ' 
12 
<20 
15 
42 
27 
15 
12 
15 
40 
24 
12 
.12 9 
16 
58 
42 
20 
• 10 ' 

' 11 

' 16 
23 
12' 
11 
30 
15 

• 15 
'52 

. 15. 

. 25 
12 

154 



62.6 

' 64.7 
66.2 
67.4 
64. S 
62.1 
61.6 
61.5 
67.1 
57.3 
62.J. 
62.5 
66.0 
79.2 
78.9 
72.1 
58.7 
55.2 
52.5 
63.6 
55.4 
68.5 
52.9 
48.4 
62.8 
61\6 
64.6 
57.-8 
64.9 
63.9 
63.6 
66.1- 
'61.1 
64.4 
60.4 

6i,;5 

• 59.0 
74.7 
54.6 
57.6 
59.0 
53*5 
64.9 
67.5 
69.1 
65.4. 
62.7 
J69.6 
65.0 
4?. 4 
61.1 
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Table 11' shows that California sixth grade students had an average percent 
correct score of 62.6 on the 480 questions in the total test. The skill-by-skill 
results were: 64.7 percent correct in counting, numeration, and place value; 
61.6 percent correct £rf nature of numbers and properties; 62.5 percent correct 
in operations; 62*8 percent correct in expression^ equations, and coordinate 
graphs; 63.9 percent correct ia geometry; 60.4 percent correct^ measurement; 
59.0 percehp correct in probability and statistics; 67.3 percent correct in 
tables, graphs, afid integrated applications; and 62.7 percent correct in problem- 
solving. From Ta>ble 11, the following conclusions are apparent: « 6 , 

• Sixth grade students scored highest in adtfition/subtractipn, of whole 
numbers, with an average percent correct score &f 7*9.2* The next 
highest subski'll score's were 78.9 percent correct in .multiplication 
•of whole numbers and 72. L percent correct in division of whole num- 

• Sixth-grade students typically scored Higher on skill, questions than 
application questions. However, for. nature of ^numbers and proper- 
ties; expressions, equations, and coordinate graphs; and geometry, 
students 1 scores on application questions exceeded their scores on 
Skill questions. 

• In operation applications, sixth grade students scored 68.5 percent 
correct in one-step problems involving whole numbers and 52.9 per- 
cent correct in one-step problems involving rational numbers. They, 
scored lowest in applications problem of two or more steps involv- 

• ing whole and ratiprial numbers, with x an average percent correct scos^ 
of 48.4. * - / 

o In measurement/ sixth grade student scored higher on questions in 
U.S. Customary units than ^n 'the questions in metric units. 

• Among the four basic operations, students have mos^ facility with 
addition, subtraction, and multiplication of whole lumbers followed 
by division of wholfe numbers and operations on decimals. ^ Students s 
have4he greatest difficulty witb operations involving fractions. 



J 



The committee members also identified the areas of strength or improvement 
and areas in need of improvement. The areas of-strength included those skills 
in which students achieved at or above 'the committee's expectation or the skills 
in which the scores are below committeejs expectations ]>ut are improving. The 
areas in netfd of improvement included ^the skills that the committee members 
woul4 like to have particularly emphasized in the mathematics instructional 
> programs. »» 
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in a whole number 
in expanded notation" 



Areas of strength 

.^Identification of rational numbers in word form, given the fraction 
form . * - , . 

Identification of the. p|^e valite of a' given digit i 
Identification of numeralV^or whole timbers given i 
Identification of ord6r symbols 
. Tdehtif ication o^f order relations for a given set of decimals 
Identification 'of * odd or even numbers 
Identification of multiples 'of given whole numbers 
Application of the order relation \ising whole numbers 
A4dition, subtraction, and multiplication oiL whole numbers 
Understanding of ^he multiplication algorithm for whole numbers 
^Redaction of fractions to the-lowest terms » k * 

Applications, one-step, using addition of whole numbers 
Evaluation of simple expressions involving addition, subtraction or v. 
1 multiplication « * 

Identification' of appropriate linear units of measure ' 
Calculation of perimeters of common geometric figures 
Identification of the mode of a given list of data 
Interpretation of, data given in the form of a table 

Identif ication°of relevant mathematical problems for given situations* 
Identification of facts, questions, or unknowns irit given problems 

Areas in need of improvement 

Identification of the place value of a given digit in a decimal 
Understanding of the exponential fonn of a number 
Identification of prime numbers and prime factors 
, Identification °^ the l east common multiple and greatest comrion factor' 
" whole .numbers * , "*~ » 

Division of decimals • f 

Addition and subtraction of fractions with unlike denominators 
Multiplication and division of fractions 
Applications, one-step, involving multiplication or division of fractions 
Applications, one-step, involving division of decimals 
Applications, two-stejj, involving fractions 

Estimation of nonlinear meaures of familiar objects (metrid units) 
Calculation of- areas and volumes of commdn geometric figures 
Calculation of probabilities of simple events 
Interpretation of data given in the form 6f a circle graph 
Selection of appropriate operations t^ solve giveln problems that involve 
division 

Checking a*given answer in a problem 
m Recognition of a sensible answer to a given problem 



The committer's recommendations 

• Increased instructional emphasis should be given to the sharpening of 
ttje concept of place value leading to the understanding of the role of 
zero in numeration and decimal notation* 
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It is recommended th*t instruction* emphasis be continued in the use 
and^'understanding of metric units. 



„ Increased instructional emphasis on the understanding and reading of 
Cartesian coordinate graphs\through the u*e of paper/pencil games and 
computer-assisted activities is recommended. 

• The representations of division expressions should be varied so that ^ 
students are aware of the ^different forms used. . • 

• The instructional emphasis on the development of problem-solving 
skills! Particularly estimation and checking skills, and on recognition 
of sensible Answers should be continued. 

• The committee members cautioned against the ■ tendency to develop a^ 
narrow, computational, minimum proficiency-based mathematics curriculum 
in grade's four, five, and six. They, felt that all students need a 

" oroarcbmpreh^sive' instructional .program in these grades , , covering • 
• all objectives in the mathematics framework. Concern was expressed that 
a substantial number of students are being brapped m a repetitive 
cycle- arithmetic computation 'instruction and are not being exposed 
to any other mathematical concepts or skills throughout 'their- school . 
years* 

Committee's Analysis of Skill Area Results 1 

" The members of the Mathematics -Assessment Advisory Committee reviewed 
fee results of the sixth grade students, by skill area and by items within 
Wh skill area. The' committee members judged the adequacy of student 
^r-n e in light of the difficulty of the questions and the relative 
instructional ^phasis. of each skill in the typical classroom. 

The instructional^emphasi's data were provided by the teachers who 
reviewed the test -questions during the test construction phase of the 
sixt^grade Survev.: The teachers indicated whether the emphasis on a 
SrHcular sklTTin their school'was great, some, little, or none. They 
III in i ated whether the level of skill considered appropriate in grade 
-six was mastery, developmental, exploratory, or not introduced. - 



"M^tery- ~The student is functionally competent and able to apply 
skills and knowledge in an.organized and effective way\. 

Developmental: The student is in the process of learning a concept or 
skill. - , * 

Exploratory! .The student is being introduced with some degree of guidance 
to new concepts, materials, or skills. 
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» 

♦The results of the committee's analysis are summarized below, by major 
skill area^ * The main purpose of this analysis was to px>int out areas of 
strengths and weaknesses that may form the basis for further improving 
instruction in California classrooms. Illustrative examples indicating 
students 1 actual perf ormance* are provided to indicate areas of special 
strengths or weaknesses; however, these examples should not be taken as 
indicative of the" typical student performance in an entire skill area. 

• 

Arithmetic numbers and operations 




I? 



The skills included under arithmetic numbers and operations are counting 
numeration, and place value", identifying relational symbols and phrases; 

w . * identifying the least or 

greatest whole number, 
decimal, or fraction 
c from among several numbers, 
using the commutative, 
associative, and distribu- 
tive properties and 
properties of one and 
zero; identifying factors, 
multiple, least common 
multiple, greatest 
" # . common factor; and the 

basic operations 0 f addition, subtraction, multiplication, and division on 
whole numbers, decimala, and fractions. . * 

*The committee members felt that, in general, students performed well on 
addition, subtraction, and multiplication problems presented in vertical 
format. The Committee members were very pleased to note that students 
performed well on most operation problems with whole numbers, even those 
with a number of renamings. Notable success was achieved on a ( subtraction 
problem that included three renamings and a double zero in the minufend. 
This problem was correctly solved by $5 percent of the students. . ' t 



4003 
209 



5 04794 
2 O 3*806 
8 O 3804 
85 # 3794 



The following problem, which includes two renamings along' with numbers 
generally considered to be difficult, was answered correctly by 95 ^percent of 
sixth grade students: 



7876 
4 6689 

95 • 14,565/ 
2 O 14.555 
^ O H # 465 
r O 13.455 
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Of the several areas in which students had difficulty, two areas drew 
particular attention from the committee members-mathematical vocabulary and 
understanding of place value. The- committee discussion m these two areas 
follows* - * 

Ma thematical vocabulary . Students have some difficulty* understanding and 
using the vocabulary o f arithmetic. On the fo owmg^item, 25 percent of 
the students did not know that "finding the difference" involves subtrac 
t^on! Six percent of the students .elected addition, and 13 percent chose 
division for their answers. 



r 



' To find the difference between 83 and 1 8, you: 

6 Oadd 

75 # subtract 

5 O multiply 

14 O divide 

V — t 

<5imilarily, for multiplication; o\ily 46 percent of the students correctly 
identified tne "product" of 8 and 2. 'Twenty percent chose 4 as the product, 

! X l ,L co in Although division vocabulary was not. tested as 
such the^esults on \t folwng item indicate that* students had a fair • 
unders anding of the relationship between the horizontal format and the more 
cradltional algorithm; seventy-two percent of the students chose the, correct 
response. , t „ 

- — \ 



r 



75 + 25 = 3 is the same as 



75: J , 

2 03^ . 15 075*25 . 

* ' - 25 3 

11 72 #25r7T 



'Th/ California Assessment Program t test assesses students' ^standing 
i , y a f i™o A« factor product, addend, sum, even, odd, prime 
of such words "^"^JjJ^/^tiple; lease common multiple, greatest 
number, prime. -f actor, J* ^ £ * the te8t development phase, 95 

commor ; factor -an common - jj-ing 

percent °!/^/^"J„° loey P f or addition, subtraction, multiplication, 
n at h »a t S of developmental* level; however, corresponding 
Tercentages for prime number, greatest common factor, and lowest common mul- 
tiple were 45 to 49 percents. 

Ihe c^tc.. « r r.W„,.a coogro over the l^core. in e.^inol- 

mathematical t*™ 1 ™ 10 ^ / students study vocabulary and grammar, it is 
^ inrcant^ r r : tSe ^o FLt l2S to understand and use mathematical . 
^as U i! ^ to lea" the syntax of the foreign language. The committee 
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members emphasized that learning the language of mathematics stfSuld begin in 
the early grades and should continue throughout the school's mathematics 
program.' *> y % 

Place Value * Questions in* place value on' the sixth grade Survey ranged from 
identification of numbers "100 more, than 11 or "100 less than" to operations 
with decimal fractions. The committee' members noted a lack of understanding 
of place value concepts, required of sixth, grade students, ^throughout the 
arithmetic section of the test. The following example is a clear illustra- 
tion of place value difficulty: 



> 4 
8 
65 
23 



100 less than 32.013 is. 

Response Characteristics 
Failure to rename * 
Using a wrong operation 
Correct 'answer 
Subtracting from thousands 
^instead of hundreds 



O 32,913 
O 32.113 
• 31.913 
O 31.013 



£n the above example, although 65 percent of sixth* gracje # students" 
correctly answered the item,- 23 percent confused the hundreds place with the 
thousands plac.e, selecting 31,013 as' the answer. " 

. - , Although sixth grade students lack a deeper understanding of the pTace 
V&l,<u& concepts, they seem to understand place values for whole numbers and 
per£orm well on whole number, addition and subtraction questions even those 
with a number of renamings. ^However, students seem to have cpnsiderable 
difficulty with decimal fraction* operations. In the following epcamplie;, 19 
percent of the students confused tens place with the required tenths, while 
about 29 percent ^incorrectly selected a humeral showing the seveh in either 
the onfes or 1 hundredths place. The- question was answered correctly by 52 
percent of the students. 



Wftich numeral has a 7 in the tenths place? 

19 t) 376.3 .. .. 

16 O" 97.63 

52 # 9.763. 

13 O' 0.9763 



In the following dejpimal subtraction problem, 36 percent of the students' 
ignored the decimal poiflft, while .another nine percent failed to note the 
difference between the tenths place and the hundredths place. 
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95.6 - 8.t)5 = 

36 O 0.151 

9 O 87.1 

51 • 87.55 ' 

4 Q103.65 
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Confusion was even greater in operation questions involving whole 
numbers and decimals. W.' problem below was answered correctly by only 33 
percent of the students. £ixfcy-orie percent of the students obviously placed a 
•decimal point before the number 12 before adding and then selected the first 
answer as correct. 



K. 




V 



The results were similar for other operations with decimal fractions: . 
students ignored decimal points, improperly aligned horizontally presented 
problems, and' failed to understand the^meahing of fractional plaae values. 

Although positional va~lue is not technically considered place value, a 
similar related difficulty arose with positional value. In grades prior .to 
the sixth grade, it is common to find students subtracting a partial minuend 
from a partial (subtrahend instead of doiftg the necessary renaming. For 
example: 4 '\ , 



84 

63, 



" 1 ' 



This lack of understanding extends to; operations with fractions at the 
sixth grade level. For the problem below 347 percent of the students chose 
the response 2 1/4, not realizing that 1/4 i should be subtracted from a 
renamed unit. Another 10 percent of the sixth grader's selected 2 3/4, also 
failing, to rename* *~ «*• 



. it * 



10 02f 
47 0 2t 



39 #lf. 

4 0\\ 



J, 
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■ The committee members remarked that although, sixth grade students have 
a basic understanding of place value skills, the concept- of place value 
needs additional emphasis in classrooms to sharpen students understanding.' 
The members also observed that the fraction items on the test are all 
cLonly used fractions such as 1/2, 2/3, 3/4, etc., and that the students 
were unable to show 'facility in performing operations with such frafctaons. 
They emphasized the role of fraction operations, especially as it relates to 
achieve success in learning algebra. 
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Expressions, geometry , measurement , and probability and- statistics 

«# ' * ' * '. ; f 

* Each of these sections of the test consists of a section on computational 

skills or recognition sub- 
skills and an^ applications 
section involving word 
problems. Tbe results, on 
the application it$ms are 
described in the next sec- 
tion; the results on the 
v skills j.tems ara presented 
next. * „ 




1* 

n 

Jo* 

n 



J 



Expressions , : equation?/ and coordinate graphs . The questions in this p^rt 
of the Survey- irnvplve translation of algebraic expressions into English 
phrases/ evaluating simpXe'algebraic expressions, locating points on a .* 
coordinate "graph, and identifying either the rule or a missing number in a 
function table. ^ „ ' . 



The survey of teachers during the test construction phase indicated ^ 
that* most *of the skills in expressions and £qua-tions were .at j:he ^exploratory 
level. The committee was generally satisfied with the score of 62.8 percent 
correct in these skills, which was slightly above the total mathematics" 1 
score of. 62. 6 percent .correct. Among the items on coordinate, graphs and 
function rules and skills, the' cpmmittee observed that the scores were con- 
sistently low onfy in the 1 subskill of identifying points on the ^coordinate 
plahe* A closer look at the student responses indicated* that most of th^* ( 
errors that occurred involved reversing the order of the coordinates (see 
the example below) » * 
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3 4 



Vyhj^tfrdered pair gives the location of Ppint A? 

51 0'(3&) . 

2 00-4) 
45 •(2.3) 



J 



The committee members indicated a need .to emphasize "conventions," such 
as in ordered pairs , in th£ classroom. 1 
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Geometry . The questions in this' part of the tegt involve identifying 
two- and thr£e-dime>nsional geometric shapes, recognizijg line segments, 
rays, radii; diameters, typg of angles and triangles, parallel and perpendi- 
cular fines, and similar and congruent figures*. N Tlie questions also 'pertaitt , 
t6 lines of symmetry-, measurement of angles with tfie help o£ k protractor, 
and recognition *)f spatial relationships., 

' > s * \ i 

The survey of teachers indicated that "sotae" or "little" emphasis was 
placed in t the classroom on these skills and that the. 4k ill level was consid- 
ered developmental* or exploratory, but that the teachers did want these 
skills tested on* the Survey . The students scored 66.1 percent correct on 
shapes and terminology and 61.1 percent correct on relationship questions. 
The committee's review of these items revealed that students had some 
difficulty with t^-^etpendicular ity relationship in particular, and with 
spatial relationships in general. Students were especially strong-in 
identifying angles and congruent figures. 

.Measurement . >The questions in this part of the Survey include subskillsbn 
estimating- length, area, volume, and mass ; choosing appropriate unit£ for 
measuring an object o*f« a given length, area, volume, or mass; and convert-irvg 
from one unit to another within the particular system. The questions 
include items on both .metric and U.S. Customary itfiits, with a predominance 
of the questions dealing with metric units. 



9 Choose the most appropriate unit to measure 
the length of a paper chf> 

13 O meter ; 

9 O kilometer ♦ y 

11 O decimeter 

67 # centimeter m 



The committee's review of these itemS revealed that students are weak 
~in Understanding of measurement units in the metric. system, in understanding* 
of concepts involving volume, and in recognition of basic formulas apd their 
application. On the example below, 67 percent of the students answered the 
question correctly; however, the remaining 33 percent apparently had no 
knowledge of metric measures of length. 

Probability and Statistics* . The questions on probability require students, 
to select the probability of an event ox the complement .of an event, iden- 
tify, the probability for an event certain to. occur or not to* occur, and find 
probability associated with, for example, the tossing of a coin or the 
stopping of a pointer of a spinner. The questions on statistics infclude 
items on finding the mean, median, mode, and range of a given set of numbers. 
All questions in this category are presented in simple application format 
involving, real life situations. 

• " f i ** 

- jThe survey of .teachers during the test construction phase of the 
Survey f s development indicated that they place little or no instructional 
emphasis on skills involving probability} teachers identified most skills at 
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either t,he exploratory, level or "not introduced^" The committee' felt that 
lesser epfffralris on these skills in classrooms is probably due to a lack of 
ins true tjfionai materials in many textbooks. However;, students scored 59.0 
petcent Correct "on these it#as, which was lower than the score for the total 
test but litgh^r than the committee members expected* In statistics, with 
£he exception of the, computation of the average of a given list of data, 
teachers rated, skills in the same way that they rated probability skills. 
The scores of Students ori statistics items" was 64.9 percent correct, .which 

JL. 

was higher than the average .percent correct for the total test., The follow- 
ing SXample illustrates the performance of students on a typicat^J^obaHlity 
„ question: - 



STUDENT WORKERS . 


Class 


Number 


Grade 5 


210 


Grade 6 


200 


Grade 7 


260 


Grade 8 


220, 



If tha <»amo of one of the students irvthe classes 
above is chosen at random fcr * certain job that 
student'wilt most hVely be in « 

3 C Gr*de B * " 

13 CGr*de6 

(3 • Grade 7 

21 0 Grade 8 



The comraittee^eratiers •recommended greater instructional emphasis on 
probability antf statistics in classrooms- The basis for their recommendatio 
was the broad general usage of these concepts in. the everyday lives of our 
citizens and the importance of these skills in Preparing for business and 
technology. 

Problem ^solving/applications ^ • 

la ordeif to assess student performance in problem solving/application 
skills, the committee incorporated several unique design features , into the 
new Survey . First, the test contains questions in skills. as well as ai 
cations for each major strand of mathematics* Second, it includes m^ 
questions such that a computational question has its parallel in a 
problem involving the same computations. Third,, a variety of^appli^ 
questions are designed to assess student achievement in on<?- and muib^step 
word problems. Fourth, problem-solving question^ unique to CAP were written 

by committee members to ap&ess 
achievement in ptoblem formulation 
analysis and strategies, and 
problem interpretation. Fifth, 
integrated^ applications, also 
unique to CAP, are jmj tended to 
assess skills involving knowledge 
in two or more math skills in 
*a "life coping" situation. 
Whereas skill questions assess 
student achievement, in computa- 
tional skills, the one-step 
problems assess achievement in 
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ictentlf icatton of correct operations, and multi-s'tep problefms as$ess ability, 
in critical thinking in a problem situation. On problem-solving questions, 
students are required to think about the Situation and respond' with something 
-other than the' result of an arithmetic computation. 



One-step applications . A one-step application problem is a word problem 
that is reduced to a one-step computation — adding, subtracting, multiplying, 
or dividing. Th£ problems on the test involve both whole numbers and 
rationals (decimals and fractions). m 

The average score on one-sfe? problems involving whole numbers was 6*8.5 
percent correct as compared to 52.9 percent correct for similar problems 
involving rationals. The difference in student performance on whole number 
and rational number applications is primarily ^Jfcbi^ result of students 1 not ' 
having mastered computational skills in dedifnals 0>5»2 percent correct on 
multiplication and division and 58.7 percenjt correct on addition and sub- 
tract iyi)^ or fractions (52.5 percent correct.) to th<* same degree that they 
have mastered computations with whole numb^ets (79.^ percent correct in 
addition and subtraction, 78.9 in multiplication, v /and 72.1 in division). Ih 
one-step- problems, the context of- thef problem* g ^relatively unimportant • 
except to identify the choice of the operation. The following examples 
illustrate student perfprmance in one-step whole number application and in 
S or^e-step decimal applications: # , 



The phone book has 17.751 listings of businesses 
and homes ,2.686 are for businesses. How 
many are for homes? ^ 

74 # 15,065 ' 

5 O 15.135 * 

6 O 15,165 . . , 
15 0 20,437 



JfK paper clip weighs 0.5 gram A piece of paper 
weighs 0.03 gram How much would the paper 
and the paper clip weigh? 

13 O 0.008 gram 

7 O 0.015 gram l 

36 O 0.08 gram 

44 • 0.53 gram 



When the same numbers were given as whole number or decimal computa- 
tions, 92.1 percent of the students correctly answered the whole number 
question, and' 61.0 percent correctly ansWered the decimal question. Student 
responses revealed that most of the students knew the correct operations; 
however, many made errors in aligning the decimals or place values of/* ^ ^ 
numbers. About one-half (46 percent) *of the sixth graders chose the .wrong 
answer because they aligned the right mo$t digits of two decimal numbers 
without regard to the decimal position., " 

Multi-step applications. The ward problems ih thi§ category involve two or 
more steps of operations. The percent correct for multi-step problems was , 1 
48«4, which was not only^oWer than the score for one-step problems involving 
whole or rational numbers but also the lowest score on the Survey . In 
contrast to one-step' problems, in which the context of the story is unimpor- 
tant, in two- (or more) step ^problems, the context ot s the^ story becomes 
important for correct solution. The example below illustrates the perfor- 1 
mance of sixth grade students oh a two-st,ep problem that involves identifying 
"the features that are significant to the central problem. 
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It is 1.3 kilometers f/om Sharon's/ house to 
school. She rides her bicycle to and from school 
every day. How far does She ride in 5 days? 

7 O 6.3 kilometers 

68 O 6.5 kilometers 

5 O 10 kilometers 

20 #13 kilometers 



In the above question, the predominant error (68 percent) "resulted from 
studentS' ignoring ,M to-and-f ro" parts of the question and answering simply 
1,3 x 5 a 6,5,' The correct solution requires additional multiplication: 2 x 
. 6.5 * 13. In multi-step problems^ a general error was to respond as if only 
one step were required." The committee members noted that questions such as 

. , these have been used infrequently in 6ommonly used grade six textbooks. 
They recommended that teachers spend more time in developing critical 
thinking skills through class discussions and homework assignments using 
concrete problem situations. 'Since computation is not the critical skill to 

. develop thinking skills, the committee members emphasized the use of calcula- 
tors in conjunction with class discussion and'homewprk assignments for such 

' problems. 14 

- • \ ■ ■ - \ ' '■ 

Applications in expressions, equations/ geometry/ measurement, graphs, and • 
, integrated applications . The application questions in these cat^goriefs 
involve applications of skills in practical situations. From Table 11 it is 
apparent that the percent correct for applications was greater than the 
w percent correct £or skills in geometry (64.4 vs 63.6) and .expressions artd 
equations (64.9 vs 61.6). Of the nine major categories on the Survey , the 
.highest score r was 67.3 percent correct fpi| tables, graphs, *-and integrated 
applications. 



The cojnmittee's review indicated that generally where students are weak 
in applications they are also weak .in skills. Qn measurement computation 
questions, students were able to find perimeters of figures when measure- 
ments are given on the fitfure, but' in most application problems they seem to 
apply the given numbers in a raqdom fashion without regard to their meaning 
ih the problem (see the following; example) . 
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Jim and JudLy wanted to put a rati fence around 
their rectangular 'lot They wanted the posts to 
be spaced eight feet^apart 

How many posts will they heed? * 



22 on 

*2 •H 

20 C16 

16 Q18 



24 ft 



32 ft. 



• The students in the sixth grade are also weak in interpreting data from 
circle graphs (49.8 percent correct) and interpreting data from 'charts (51.9 
percent correct) ♦ The example that follows illustrates their performance on 
a circle graph questiop: 



What part of Sam's day •$ spent eating, playing, 
watching TV. and sleeping? 



38 O i 
3 O* 
13 0£ 



46 # 




1 s Student scores ' were , strong, however , -'in. interpretation of data from 
tables (83*0 percent correct) and interpretation of data front bar graphs 
(75.7 percent correct).: in general, students did better on items vftlere-^they 
simply had to read a .table or graph than on items Jihat required them to inter- 
pret information or do some computation with the data: 

. Problem Solving . Of the th£ee types of questions in this category, 
problem formulation, analysis and strategy, and interpretatipn, students 
scorned highest (69.6 percent correct) on problem formjulation questions and 
lowest (49.4 percent correct) on interpretation questions. In fact, after, 
the multi-step application problems, interpretation problems vfere the most 
difficult of all skills on the math portion of the Survey . 

Problem Formulation . The skills in problem formulation include identifying 
problems or situations that can be represented by given mathematical mod'els, s 
s^ch as number sentences, equations, diagrams, tables, and graphs. The follow- 
ing example illi^strates the perfrorm^nce of sixth <ijrade students on a question 
in' problem fprmulation: 



12 °. *lc,) 
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A 

Which* problem is suggested by the above 
diagram? 

16 O What is the diameter of a 6-inch circle? 
67 # What.is thje area'of the floor? * 
12 O How much will it C09t for„8 items? 
5 i Q How /nany halves are there in 6 app^s? 



V 



The committee members noted that students were able to match a wtfrd 
problem to a given number sentence when the numbers in the problem were 
dollars and cents* but noted that students found a similar problem involving 
decimals more difficult In all cases, where a drawing or diagram was* , 
presented, the students had some difficulty applying it to a correct problem 
situation. In the example above, only 67 percent responded correctly, while 
approximately ?6 percent chose either the first or third response. 

Analysis and Strategy . Analyzirig problems involves identifying the 
significant features of the central problem, a*nd planning strategies to deal 
with them* Planning might involve guesswork, estimation,, drawing of dia- 
grams, creation, of concrete models, listing of similar elements, or breaking 
of the problem into manageable parts. A critical step in problem analysis 
is translation ""of the problem into mathematical symbols, because it demands 
an explicit definition of the problem and selection of an appropriate • '* 
Strategy for solving it. The step also demands risk taking. The following 
exdfaple is from ttte questions on identifying £iven facts, unknowns, or 
quelfeions (significant features) in a ,given problem: * 



3 

1? 
4 



36 children are in the room. 4 children are 
sitting at each table. How many tables ere 
being used by the children? ■ 

\{/hat are you askedlo find out? 

O The number of, children in the room, 
# The number of tables being used. 
O The number of children at each table. * 
O The number of children in 4 rooms. 



Although about 75, percent of the students answered questions similar to 
the above example correctly, the responses of the students on other questions 
indicated that they not reading discriminately. The studAits $re not 
paying attention to specific details 1 in the prose or the specific question 
asked. / 

The next example is an illustrative question requiring an .appropriate 
operation that will lead to the solution of a given problem. 
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Mr. Higgins/nade 2 hamburgers for each child 
at the picnic. In all. he made 32 hamburgers. 
Howtnany children were at the picnic? 

/' ■'■ ■ • 

Which expression will "help you solve the 
problem? ^ 



20 O 32 x 2 
6 3 O 32 + 2 
45 • 32 + 2 

29 jQ 2+32 



.The committee members ndticed that students, have .some difficulty 
knowing when to multiply or divide, and the Larger the 'number in the problem, 
the mote difficulty they have in selecting the appropriate operation. 
Students also s$6m ta have difficulty relating -a division problem with its 
horizontal form. In the example just presented, 74 . percent of the students 
knew that division was the appropriate operation, but only 45 percent 
"selected the correct response. • ^ 

* aJ' > " * i ■ • • 

f , The example below' is an illustratipn from questions on identifying 

mathematical nfodels, such as number sentences, charts, and tablets' for a 
given problem. The example was answered correctly by less than half%the 
students. ' * 

* ^ r Happy ahd Al lived the sacne d'Stance from 

the school, but in opposite directions ^Thev 
found that they lived 600 meters apart 

Which drawihg shows this? 



15 CP School 



46 0 H*j*y 



36 Q hw, 




3 O • ch0< * 









Al 


1 250 




250 






ScftX4 




AJ 


' 500 


— 


900 






J 

Htm 




Al 

~~4 



The committee-members .felt that^perhaps many kfudent*s have had little 
experience ^making drawing or diagrams of mathematical situations. , 



The following example is an illustration from questions on' identifying 
missing or extraneous information in a given problem. 

' ' M l 1 



The 130 students from Mane Curie School * 
are going on a picnic in Carson Park. 
Carson Park is 1 2 miles from the school. 
Each bus hdlds 50 passengers. Hovtf many 
buses are needed? 



/ 



Which numbers are needed to solve this problem? 

9 O 130 and 12 , . 

63 • 130 and 50* 

12 O 12 and 50 • 

16 0130,12, and 60 
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The committee members noted that such problems are relatively new to 
most math programs and textbooks* Yet, it is imperative that, in real-life 
situations, Students be able to sort through the information they have (or 
identify information they do npt 'have) and select thet relevant data. Only 
65* percent of the students were able to select the relevant numbers in the 



example just^ given. 



The example below is an illustration from questions on using guess and 
check (trial and r error) strategies tp solve problems. Guessing and check^jftg, 
*ar trial and error, is an appropriate starting point when a method t6 solve 
a problem is not immediately apparent. 



) 



□ x*Q = 1849 



The number in each bdx is the same 



2 
30 



OThe number is between 0 -1 0. . 
• The number is between 1 1 - 50. 
36 OThe number.is between 51 -100. 
32 OThe number is larger than ,1100. 



'This approach, which is used frequently by adults in everyday situa- 
tions, seems to be almost unknown to sixth grade students. In the example 
above the last three resp9nses were chbsen almost equally by the students. 

The* ensuing example is an illustration from questions c?n estimation to 
predict reasonable solutions and identification of problem solving tactics 
needed to solve a given problem: * 

c. ■ ' - ' 

1 . J J x 

tfolanda bought 1 groceries that cost $3.65, 
$1.25. $4.99, $27 95. and $0 15. 

Which of these is the best estimate of her total 
co&t? 

16 O $4 + $2 + $5 + $2lB + $1 
23 O $3 + $T * $4 + $27 + $0~* ' I - , 
• $4 + $1 $5 + $28 + $0 
. ' 9 G$i + $1 +$5 + $27 + $0 



The committee members remarked that rounding and estimation are fre- 
quently, txsed in everyday lif£, whether one is shopping to^L groceries, \ 
determining cooking time for a dinner, or determining whether an answer to a 
. problem worked oft a calculator is reasonable. /'"Ifet, most: students get ,,very 
little practice in estimating. In the example, only simple rounding skilly 
are necessary to 'determine the solution, £et only 52 percent of the students 
answerefl this item correctly. 



:RLC 



Interpretation . Interpretation skills require students to review the 1 
prpblems and answers, judge, the validity of their translations ta Mathema- 
tical ^yrabbls, and Check the accuracy o£^ their use Of mathematical rules. 

The example below requires students to check their scrlutions in*the 
context of the original problem. The committee members remarked that 
students are accustomed to using arithmetic to solve word problems and that 
they have "learned" that the answer to their arithmetic is the "correct", 
answer to th^ word problem. 
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The 1 30 students from Mane Curie School are 
going on a picnic. Each school bus holds 50 
passengers. How many buses will'they need? 

Rose worked the following problem: # 

' 2_ • < 

100 

30 ' 

Look back at <he question in the problem 
Which answers it? 

5 O* 11 0 2f 

55 Q2R30 29 #3 



They need tp have more experience in "making sense" put of the answer. 
In the example the^s are several "dArrect" answers £& the arithmetic problem, 
but there is 'only one "sensible" answer to the question in the word problem. 

c <~ 3 

\ J ~ ' 

The next example is, an Illustration from questions that require students 
'to dr^w reasonable conclusions by analyzing ©reinterpreting given information 

Ann* 1 is cutting * who)* ptzza into pieces of* 
, about the same size Which sentence below * 

is true? 

* , O The lergtr each piece is. the more pifces 
there are, I 
, 5 O The smaller each piece is. the fewerWiece* 
" there are, , \ 
# The larger each piece is, the fewer P*«*i^ 
. there are 

23 O The size of each piece has nothing to do with 
the number of pieces. 



The committee" members noted tfiat many students "have some difficulty 
interpreting information and relating it to their experiences In the 
example above nearly one-fourth of the students stated tfrat the *size of the 
pieces in a piiza "is. not related to^the number of pieces cut* ■ 

/ Even in $ relatively straightforward computation problem (see the 
pxample that folloVs), less than 60* percent of the—students were able, to 
draw a reasonable conclusion from the given information. ^ t 



A new school building ha? 40 classrooms. The 

* schoof ordered 28 new desks for each classroom. 
1200 desks were delivered 

Which of these is true?, 

<% 

10 O The correct number of desks was delivered. 

* • Too many^desks were delivered. 
28 O Not enough desks were delivered. 

, * O The school needed 200 more desks. 
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Summary of Committee f £ Conclusions - . • " 

In general, the sixth g^ade students performed faitly well in analyzing 
and solving straightforward word problems ^involving addition or subtraction 
of whole numbers. They did not perform as well when the operation required 
was multiplication or division. Problems that included fractions, decimals, 
or percents, even where no Calculations were necessary, were, in most 
instances, difficult for the students. *< < A 

It appears that many students are not reading the problems critically. . 
This does not seenf to be a function of reading comprehension alone, 'since 
higher percent correct were recorded for some very l^ordy 11 problems than for 
some very short problems. Students seem to. to lack^ie ability to take the 
situation seated in the problem and go one step further to make some analysis 
or inference based on ,that situation. In other instances, the students seem 
tcr be making their own assumptions about the nature p'f the problem #nd 
disregarding specific details in the situation, the question asked, or the 
response .choices. 

» ■ 

The students seem to have few problem-solving strategies, other than 
those that involve wotking an arithmetic problem, available to t them.- They 
have some difficulty recognizing, model's or drawings, using a guess and check 
technique, and identifying simp v le problems as alternate approaches to 
; solving ptoblems. ■ i« 1 
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Sex Differences In Mathematics Performance 



V 



I I » 

Boys and girls in the third and sixth grades answer 'approximately the 
same number of mathematics problems correctly, but they differ on the ) 
.particul'ar items they able to solve. Table 12 illustrates the differences 
in .the performances of girls and boys in various skills at the third and 
sixth grades. » * • " ' ' 

i i 

, ' Table 12 

Differences in Achievement of Girls and Boys for All 
Mathematics Areas of the Third- and S^xth-Grade CAP Tests,, 1981-82 



Category 


1 vins average otvic 
| third grade 


sixth grade 


CDunting and place valUe * 

Computations 

Applications 


-0.10 
v +0.54 


-0.74 

-3.41, . . 


Nature of numbers and 


» 




properties 
Computations 
/Applications 


, +1.32 
'+0.75 . 


t 

. " +0.4 
-0.58 

» 


V 

Arithmetic operations < 

Computations 

Applications 


+1.89 
-0.62 

5 


+2*30 
-1.48 


Geometry 

Computatipns 

Applications 


+1.34 1 
+1.31 


-1.57 ' 
-0.83 

4 


Measurement 

Computations 

Applications 


• -0.68 

1 


-2.56 
,-2.56 

j 


Patterns/graphs' 
Computations 

Application^ — 


i 

-0.19 
+1.88 


+0.84 
-0.24 


Probability 
Statistics 




-3.87 
-0.43 

i 


Problem analysis 


+2.88 

r 


+1.37 



, The values in Table 12 were obtained by subtracting the average boys 
score from the average girls' score. A negative .value means that boys 
performed better than girls. A positive value means that girls performed 
better than boys. 



126 t2{j 



T~~ 



In terms of the numbers of areas in ^hich ojne stex or the other excels, 
girls are are outperforming boys at the third grade level. O'f the 15 types 
of problems given 'in fable 12, third grade girls ^sug^ass third grade boys tfn 
eight. The situation phanges in the sixth gradev/ Of the 15 types of 
problems listed, girls surpassed boys on oaly ft>jir. Moreover, the differ- 
ences between boys 1 and girls 1 scores ar^ .greater at the sixth grade than at 
the third grade. - - 

4 One surprising result is that, although sixth grade boys do better than 
sixth grade girls on problems of application, they are less capable than 
girls on questions of problem Analysis. The problem analysis questions ask 
the stiidents to identify .relevant information in a problem, to estimate an 
answer,, and to identify the appropriate mathematical model. The following 
example requiring students to analyze the problem shows that four percent 
more girls than boys answered the question correctly;" 

. — 1 jui ; . 



36 children are in the room. 4 children are 
sitting at each table. How many, tables are 
being used by the children? ' 

Boys Girls Whaft are you asked to find out? 



4 

73 
18 
5 



3 
77, 
17 

3 



O The number of children in the room, 
# The number of tables being used. 
O The number of children at each table. 
O The number of children in 4 rooms. 



The results that grade si^ boys are better at applications than girls' 
is not surprising. Similar results have been published by CAP in previous 
years and have been found in other studie^. The findings on t\ie analysis 
questions indicate, however, that sixth grade girls have developed problem-' 
solving skills but that fhey^are not using these skills on. application 
items. , r* 

The largest and most consistent difference between boys 1 and gitls 1 
performance on the CAP tests is in the area of measurement. Girls are 
weaker in both skills and applications-in this area (in both the, third and 
sixth grades). For example, on the sixth grade test, the following item 
appears: , 

¥ 

Choose the best unit to measure the length of a t swunjQing P90I. 



o 
o 
o 
o 



degree 
foot 
gallon 
mile 



Four times as many girls as boys selected "mile" as the best unit to 
measure a swimming pool. Eight percent of all girls made this choice. 
Similarly, girls have difficulty in estimating size: 
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A hand 'is used to measure the height of. a horse. The hanti 
is 4 inches long. How tall is *a hprse that measures 15% ^ 
hands? <* - . - * ^ 

o 15^5 inches , 

o about 5 feet , V 

o 62 feet . 

o 15% feet 



Over 16 percent of all girls responded that the horse would be 15% 
inches high, and another 18 percent felt, that it would-be 62 feet tall. 
While many boys alsopade these, errors, they did so in fewer numbers. Sixty 
percent of the boys answered* correctly; cfnly 50, percent of the girls did so. 

Similar .problems exist 'with measurement at the third grade level. On 
items requiring a student to read scales (such as a thermometer ) , girls per-, 
formed more poorly "than boys; • 

{ • , 

The findings suggest that boys have more contact with measurement 
problems thkn girls-do. Perhaps boys have more experience in ,this area 
outside the classroom. The mathematics committee recommended that teachers 
stress measurement instruction with girls and that classroom situations 
requiring active measurement computation and application be presented 
frequently to all students. r 1 
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Mathematics Test Results for Grade Twelve' 



Test Scope „ 

The Survey of Basic Skills: Grade, 12 was developed to assess the degree to 
which v students have acquired "basic" mathematics skills by the end of the 
twelfth grade. A statewide committee compiled objectives atid reviewed 
questions .for inclusion in the test. The 198 questions on the Survey were 
f designed to assess students' skills in the areas of arithmetic, algebra, 
geometry, measurement, and probability and statistics/ Figure 27 is an 
illustration of the emphasis given to each skill area in the total test. In 
the figure the fekill area of arithmetic is subdivided into the areas of 
number concepts,- whole numbers, fractions, and decimals. A complete 
description of the skills assessed on the Survey is given in Test Content 
Specifications for the Survey of Basic Skills: -Mathematics , Grades Six and ■ 
Twelve (Sacramento: California State Department of Education, 1975). 

O - « • . 



Algebra 



Whole 
numbers 



Fractions 




Geometry 



Measurement 



Probability 

- statistics ■ 

r • s 

i *\ " * . < 

Fig 27 Number of Questions, by skill area, in the mathematics section of the Survey of Basic Skills. Grade 
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Mathematics Results for Grade Twelve 

Table 13 contains the twelfth grade Survey results for the total test 
and for. the five major content categories assessed, on the Survey— arithmetic, 
algebra, geometry, measurement, and probability and statistics. The results ] 
are presented for the computation and application^ portions of ea^h skill 
category. Additionally ,' the results are presented' for the Cffegorp-of . V 
problem solving, which- is an aggregation of application questions in arith- 
metic, algebra, and measurement. Table 13 shows the scores for 1975-J.6? 
through 1981-8Z and the changes in scores over the same severe ar^period 1 . . 

.A graphical representation of these, skill area results for the seven- 
year period appears in figures 28 and 29. The following overall conclusions , 
are apparent from the data in Table 13 and figures 28 and* 29-: 

r ' 

• The overall mathematics achievement of California twelfth grade 

' students decreased slightly, by 0.3 percent correct, from 1980-81 to 

1981-82. * , ..' 

, >• 

• .The 1981-82 score of 67.7 percent correct was the second highest 

score for the. seven years of "testing, being surpassed only by the 
1*9 80-8 1' score of 68.0 percent correct. < ' , 

• Computation scores have 'consistently increased over the .seven-year 
period, with an overalls increase of 2.7 percent correct for computa- 
tion with whole numbers, a 1.1 percent .correct increase for computa- 

. ,tion with fractions, ' and a 5.1 percent correct increase for computa- 
i tion with decimals. 

• Application scores have fluctuated slightly over the seven-year 
period, with an overall decrease of 0.7 percent correct for applica- 
tions involving whole numbers, a 1.0 percent correct decrease for 
applications involving fractions, and a 2.1 percent correct increase 
for applications involving decimals. 

• Number concept scores have remained nearly constant over the seven- 
year testing period with "an overall increase of 0.7 percent correct. 

, However, number theory and number properties scores did decrease 0.8 
and 0.7 average percent correct, 'respectively , in 1981--82 from the 
1980-81 scores. 

• Algebraic concept scores also remained nearly constant over the, 

. seven-year testing period, with an overall Increase of 0.3 percent , 

correct. * , , f ^' . . 

" • Geometry scores remained essentially constant, with a decrease of 0.3 
percent correct for the seven-year testing period. No change 
occurred in the scores from 1980-81 to 1981-82. 



Measurement scores h*ve generally decltned^ayer the seven years V 
with an overall decrease of 1.2 average\ perceritcorject. 
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s 



Probability and statistics Scores increased over the seven-yeat 
testing period by 1.6 percent correct. Although the 1981-82 score 
decreased by 0.4 percent correct trom that of 1980-81, this skill 
area showed the second highest increase in percent correct score 
over the seven-year period. 

Problem solving skills decreased by 0.5 percent correct- over the 
seven-year testing period. « 
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Mathematics Scores of California Twelfth Grade Stuoents and Change 4 n Scores 
on the Survey of Basic Skills: ^Grade 12, 1975-76 Through 1981-82 



Skill area 



MATHEMATICS, TOTAL 
* 

Arithmetic' 

Number concepts 

number and numeration 
Number theory 
Number properties,.* * 
Whole numbers 
Computation 
Application 
Fractions 
Computation 
Application 
Decimals * , 
Computation 
Application 

. Algebra 

Computation 
Application 

Geometry 

Knowledge of facts 
Application 

Measurement 

knowletfge of facts . 
Application 

Probability and statistics 
Computation ^ 
Application 

Problem solving^ 
Arithmetic 
Graphs^ 



Number of 
questions 



198 

98 
28 
14 

8 

6 
22 
14 

8 

26 r 
14 
. 12 
22 
14 
8 

32 
14 
18 

24 
12 
12 

t 

30 

18 

14 
6 
8 

62 
28 

34 



Average percent "correct score 



1975-76 1976-77 1977-78 1978-79 1979*-80 1,980-81 1981-82 



67.0 



72 
74 
71 
76 
79 
80 
80 
78 
66 
70 
60 
71 
74 



62.9 
66.4 
60.1 

62.7 
75.2 
50*1 

60.5 
,71; 6 
53.1 

57.2 
57.9 
56.6 

61.8 
68.5 

56»2 



66.3 

* 72.1 
73.5 

A 70.1 
75.9 
78.5 

^so.i 

81.0 
78.5 
64.5 
68.3 
*60.0 

• 13. 8 
66.6 

62.1 
65.9 
59.2 

' A 62.1 

* 48.7 

59.5 
70.5 
52.2 

56.9 
57*6 
56.3 

60*7 
1 67.2 

55.4 



66.3 

72.2 
73.6 
69.9 

.76.4 
78.6 
80.1 
81.2 
78.2 
64.3 
68.4 

*59.5 
72.0 
74.8 
67.2 

61.8 
65.5 
58.8 

61.8 
75.5 
48.1 

59.4 
70 a 
$2.2 

57,3 
58.3 
56.5 

60.6 
67.1 

55.2 



66.5 
t 

72.7 
73.9 
•70.1 
76.9 
78.8 
80.6 
81.9 
78.3 
64.7 
69.0 
59.6 
72.9 
75.8 
67.7 

62.1 
66.0 
^59.1 

61.8 
75.4 

48.3 

< 

59.0 
69.7 

si;9 r 

57.4 
59.0 
56.2 

o 

60.7 
67.2 

55.3 



66.8 

73.1 

74.1 ' 

70.6 

J6.7 

78.7 

81.0 

82.4* 

78.4 

65.0 

69.6 

5<FS7 

ft.l 

76.7 . 

68.3. 

, 62.3 
66.4 
59.1 

62*0 
75.5 
48.4* 

59.2 
69.6 
52. 2 

57.8 
59.6 
56.5 

60.9 
67.5 
55.4 



68.0 

74.5 
75.4 
72.1 
77.7 
79.8 
81.7 
83.5 
98.6 
66.3 
71.5 
60.2 
754 
79.1 
70.1 

63.5 
67.6 
60*2 

'62^4 ' 

76*0 

48.8 

60.0 
70.8 
52.9 



59, 
61, 
57, 

61. 
68. 

56. 



67.7 ^ 

74.3 
75. p 
72.1 
76.9 
79.1 
81.6 
03.6 
78.0 
66.1 
71.5 
59.9 
75.8 
79.2 
69.9 

63.2 
67.5 
59.9 

62.4 
76*0 
48.8 

59.3 
69.7 
5?. 4 

58.8 
61.3 
S7.0 

61.3 
67.9 
55.7 



Change in average percent correct score 



1975- 76 1976-77 1977-78^1978-79 1979-QO 1980-81 
to to to to to to 

1976- 77 1977-78 1978-79 1979^80 1980-81 1981-82 



-0.7 

-0.8 
t -0.8 
'-0.9 

-0,3 

-1.1 

-0- 

+0.1 

-0.2 

-1.5 

-2.1 

-0.9 

*0.6 

-0.3 

-1*2 

-0.8 
-0.5 
-0.9 

-0.6 
+0.3 
-1.4 

-1.0 
-1.1 
-P.9 

-0.3 
-0.3 

-0.3, 

~h 1 

-i'.3 
-0.8 



+0.1 

+0.1 

-0.2 

+0.5 

+0.1 

-0- 

+0.2 

-0.3 

-0.2 

+0.1 

-0.5 

+0.8 

+1.0 

+0.6 

-0.3 
-0.4 
-0.4 

-0.3 

-0- 

-0.6 

-0.1 
-0.4 

^0-r 

+0.4 
+0.7 
+0.2 . 

-o.i 

-0.1 
-0.2 



+0.2 

+0.5 
+0.3 
+0.2 
+0.5 
+Q.2 
+0.5 
+0 .,7 
+0.1 
+0.4 
+0.6 
+0.1 
+0.9 
+1.0 
+0.5. 

+0.3 
+0.5 
+0.3 

-0- 
vO.l 
+0.2 

-0.4 
-0.4 

+0.1 
+0.7 
: 0.3 

+0.1 
+0.1 

+0*1 



+0.3 

.+0.4 
+0.2 
- +0.5 
-0.2 
-0.1 
+0.4 
+0.5 
+0.1 
+0.3 
" +0.6 
+0.1 
•Kp.8 
+6.9 
+0.6 

+0.2 
+0.4 
-0- 

?+0.2 
+0.1 
+0.1 

+0.2 
-0.1 
+0.3 

, +0.4 
'•+0.6 
+0.3 

+0.2 
+0.3 

+0.1 



+1.2 - 


-0.3 


+1.4 4 


-0. 2 


+1.3 


-0.4 


+1.5 


-0- 


+1.0 

* 


-0.8 


♦+1.1 


-0.7 


+0.7 


-0.1 


+lil 


+0.1 


+ 0.2 


-0.6 


+■1.3 


-0.2 


+1.9 




+0.5 ^ 


-0.3 


+2.1 , 


< 


+2.4 


+0V1 


+ 1.8 


-0.2 


+1.2 


-0.3 


+1. 2 


-0.1 


+1.1 


-0 • J 


+0.4 


^P- 


; +0.5 , 


-0- 


+0.4 


-0- 


+0.8 


-0.7 


+1.2 


-1.1 


+0.7' 


-0.5 


+1.4 


-0.4 


+1.7 


-0- 


+1.1 


-0.6 


+0.8 


-0,4. 


+0.8 


-0.4 


+0.8 


-0.5 
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Fig. 28. Graphic representations of percent correct scores of twelfth grade students in computational 
skills on the Survey of Basic Skiffs: Grade 12, 197j5-76 through 1981-82 . 
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Fig. 29- Graphic representation of percent correct scores of twelfth grade students in application skills on 
tt^e Survey of Basic Ski/Is: Grade 1Z. 1975-76 through 1981-82 ^ 
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ithematics Results, Grade Twelve 



The Committee's Conclusions 

The members of the Mathematics Assessment Advisory Committee were 
disappointed to see the slight decrease (0.3 percent) in "the overall* 
math score in 1981-82 after a three-year upward trend. However, they did 
note tftat, in general, the skill scores in 1981-82 were the second highest 
scores in the seven-year testing period and that they were surpassed only by 
the 1980-81 scores. . / 



The committee members " identified areas of strength and areas in need 
of improvement. The areas of strength included those skills in which the 
students achieved at ot aboj&e the committee's level of expectation, THe 
areak in need of improvement included the skills that committee members 
yould like to havetoarticularly emphasized in the classrooms through a 
variety of instructional methods. 
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Mathematics Results, .Grade Twelve 



Are^fs of strength 



Identification of numerals described in words 
Number litie concepts 
Expanded notation for whole numbers 

Numbers represented -in exponential or Repeated multiplication form 
> Addition of whole numbers * 
4' Subtraction of whole numbers with or without renaming 
ifc Division of whole numbers 
ij^^j^iplication of whole numbers 

• Applications involving division facts • 
Subtraction of fractions with like denominators 
Addition, subtraction, and multiplication of decimals 
Reading coordinates of poihts in a coordinate plane 
Obtaining data from simple line graphs .and pictographs 
Recognition of common geometric figures and knowledge of geometric 
facts 

Identification of appropriate units for area measure 
Understanding of the concept of "average" , 



Areas in need of improvement 



• ^Scientific notation r 

• Conversion of fractions to decimals 
Order relation for numbers written in fraction form 
Operations with negative numbers Al 
Multiplication of numbers written in igjxed numeral form ^|#> 
Fraction application problems involving ratio and proportion 
Changing of decimal*? to percents 

Translation of verbal statements into algebraic expressions 
Interpretation of data read from graphs or tables . 
Substitution of given data, in given formula^ t 
Recognition of perpendicular and parallel relationships 
Similarity relationship and use of the Pythagorean theorem 
Knowledge of the symmetry .relationship 
Applications involving measurement ( lx 

Determination of 4 the-'median? of a given list pf numbers . y 
Applications involving the probability of simple events ^ 
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Mathematics Results, Grade Twelve 

A detailed description of these skills is given in Test Content Speci- 
fications for the. Survey of Basic Skills: Mathematics » Grades Six and 
Twelve. Illustrative test questions and the performance pf students on 
those questions can be found in the California Asseseoeiit Program 1 s Student 
Achievement itx Calif arnia Schools: 1979—80 Annual Report (Sacramento: 
California State Department of Education, 1980). 

Longitudinal Changes: Grade Six to Grade Twelve 

<p 

The mathematics scores of twelfth grade students in 1981-82 are of 
particular interest. Ttiese students were the first group tested at the 
sixth grade level in 1975-76. From information derived .from mobility 
studies, it is estimated that mord than 80 percent of the students in this 
group were tested at both grade levels. The two tests included 16 common 
items. The scores of this same set of students for these common items are 
shown below; * 



Table 14 



Type of item 



Grade six, 
1975-76 


Grade twelve, 
1981-82 • • 


Growth from Sixth 
to Twelve Grade 


76.3 


88.2* 


11.9 


77.0 


93.1 


16.1 


' 94.2 


96.9 


2.7 ; 


89.8 


^95.4 , 




50.7 


72.4 


21-7 


4 52.1 - 


- 75.1 


23.0 


29.4 " 


71.1 


41*7 


91.3 , 


94.6 


3.3 




' -70.2 


32.4 


52/1 


79.1 


27.0 


80.4 


*95.5 


15.1 


• 43.2 


65.2 


22.0 


42.7 


" '"61.9 


19.2 


44.1 


• " 71.9 


, 27.8 


49.8 


75.9 " • 


26.1 


36.1 


71:1 


35.0 


59.2 . * 


• 79.9 


20.7 



Whole number subtraction 
Whple number division 
Reading of whole numbers 
Identifying whole numbers 

described in words 
Fraction multiplication 
Fraction application 
^Decimal application 
Decimal addition 
Metric conversion 
Measurement application 
Number line 
Number property 
Prime numbers 
Subtraction of 
jP* denominate numbers 
Probability 
Probability 

AVERAGE 



On these. 16 common items, the students' scores increased about 20.7 
percent correct from grade six to grade twelve. The scores increased on 
items from all skills. Since whole number skills are attained at the 
mastery level in the sixth grade, growth from grade six to twelve is least^ 
on such skills. Most growth is seen on skills such as probability , metric 
units/* fraction, decimal, and measurement applications. v , , 
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Mathematics Results, Grade Twelve 



The Committee s Recommendations 

The members of the Mathematics Assessment Advisory Committee made the 
following recommendations for further improvement of the mathematics results 
for twelfth grade students: \ * 

. • Increased instructional emphasis should be given to solving ap'plica-' 
tion problems involving fractibns* mixed numbers, and ratios. 

• Increased instructional emphasis should be placed on using measure- 
ment instruments to understand measurement concepts and applica- 
tions, si^e these skills are such vital parts of the basic skills 
needed in*everyday life. ^ » 

• Continued development of problem analysis ind problem-solving skills 
should be emphasised strongly, since the ability to do only basic 

J^bomputations will not be useful, unless the student also knows how to 
determine whatto.doi what is known and unknown, and how to inter- ^ 
pret the results of Computations in practical problems. 
. ' 

• Some eJLementary algebraic skills are useful in formulating and solv- 

* ing problems. All % students shoiilS be given the opportunity to acquire 
these skills before they gtaduate from high school. Such skills 
include solving simple algebraic equations, evaluating simple expres- 
sions and formulas, and reading and interpreting information from 
coordinate graphs. 

• Students should take at least one year of mathematics in the elev- , 
enth or twelfth grade* so that instruction in mathematical skills and, 
concepts is provided closer to the time when many students graduate 
ai\d become working citizens' in their communities. 
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VI. Comparisons with National Norms 

. '•" Synopsis of Findings , * * 

- . California third graders have been above the national average for several 

years. The median California student is now at the 60th> 56th/ and, 55th 
percentiles in reading, language, and mathematics, 

r 

. - California sixth graders 'have been above the national average since 19/6. 
The median student is now at th { e 58th, 57th, and 58th percentiles in 
reading, language, and mathematics. 

** 

- 'Twelfth graders in California were near the national average & 1969 

when testing began. They declined sharply during the early seventies; 
their decline started to slow in the mid-seventies and to fatten out' in 
the late seventies. Students in other parts of the nation also declined 
during the seventies. Thus, when compared to more recent national 1 test 
norms, seniors, scored only slightly below or a little above those' averages, - 
depending on the particular national norm sample used. 
* • i 

Some of the difficulties in using publishers' national norms to judge the 
' adequacy of the performance of California students are discussed in Chapter II. 
Briefly, the two main problems are (1) lack of agreement among publishers 1 
samples; and (2) lack of timeliness. Any comparison based on a single pub- 
lisher's horm group (a national sample of students tested at a given time) can 
be quite misleading and is a tenuous undertakings^ best. Since no 'test is 
given nationwide, one must rely, oh various publishers' estimates of the nation^ 
wide distribution of test scores. These estimates vary from publisher to 
publisher and are clearly "guesstimates." Part of the problem in establishing 
norms is that publishers are dependent upon "the good will and cooperation of' the 
districts they select to administer their tests. When th& districts that l^ave 
been carefully' selected as part of a national sample decline to participate in 
the norming study, the ^results become that much more uncertain. In addition, 
be cause pf the expense involved , publishers are not able to update their norms 
more than once every five to eight years. 

. \ . * 

To cope with this situation, the Department's plan provides for the com- 
parison of the performance of California students with the norms of* a variety of 
tests and updates the comparisons whenever the tests are renormed or when new 
tests become available. This is done by giving a sample of California students 
both the publisher's standardized test and the California test. In some cases 
no extra testing is required. Scores for a publisher's standardized test are 
simply collected ff&m the school .districts that administered the test to all of 
their students in certain schools for other purposes. The statistical tech- 
niques used to equate the two tests are briefly described in Appendix H of the 
1978-79 report. The'result of this type of "equating study" is to show how 
California students would have compared to a national norm group if, in fact, 
all California students had taken the published test. 

This approach has several advantages: (1) the national comparisons are 
more timely since they can be updated as new norms become available; (2) the 
estimates are more stable since they do not depend on the representativeness of 
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Comparisons with National Norms 



a, single publisher's sample; and (3) the progress of California students can be 
assessed with a test that fits the objectives of the instructional program ^t^d 
simultaneously, with no additional testing, can be compared to national norms. 



The comparisons presented in this report are based on the tests With the 
most redent national norms. This report also contains the results of earlier 
equating studies so that the reader can inspect the longrterm (from 13 to 16 
years) achievement test trends in California againsjb the backdrop of national 
norms * y 



Grade Three 



Table 15 contains the estimated n'at ional . peVcent ile 'ranks of the median 
score of California third grade students 1 performance on the reading tests since 
1966-67. The trend over the years is clearly one of growth, with the third 
grade reading .scores increasing from the 34th to the 38th percentile rank on the 
Stanford Reading Test , reaching, the 52nd on the Cdoperative Primary Reading 
Test , and now increasing from the 55th to the 60th on the Comprehensive Tests • 
of Ba^ic 'Skills ( CTBS ) . In written language and math the estimated percentile 
ranks? a^e 56 and 55. Figure 30 is a pictor ial^display of these trends. 

The following outline 'should help the readejr understand more fully the 
national comparisons. /■ 1 1 1 ' * 

1. The third gradeSresults for 1966-.67 through 1970-71 were based on the 

Stanford Reading Test , which was administered to all third grade students 
in California. The norms for tho^ Stanford Reading Test were established in 
1963. Thus, the gains that occurred each year are relative to those 
norms • ' • 

' 2. The third grade results for 1971-72 through 1972-73 were based* on the 
Cooperative Primary Readiftg Test ,( CPRT ), which was administered to all 
third grade pupils in California. The norms- for the CPRT were established 
in 1966. The dramatic increase of scores in the changeover years was_ due 
largely to the great differences between the norms of the Stanford Reading 
Test and those of ^the CPRT . • • ~f 

3. In 1973-74 the California Assessment Program developed the Reading Test . 
'A systematic sample of -one-ninth of all students tested in grade three was 

used in an equating study to estimate the performance of the median pupil 
in California relative to 1966 Cooperative Primary Reading Test norms. The 
results indicated little change from those of the previous years. 

4. In 1974-75 the Reading Test was revised and administered to all. third grade 
students in California. The same test was used in 1975-76, 1976-77, 
1977-78 and 1978-79. The results of an equating study were used to estim- 
ate the performance of California students in comparison to the norms 

* "established in 1973 for the Comprehensi^ Test of Basic Skills ( CTBS ) , Form 
S. As a result of the modest increases in the third grade scores, the 
median score of California pupil performance in grade three in 1978-79 was 
at the 58th percentile of CTBS 1973 norms. * 
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5. In 1979-80, the new Survey of Basic Skills: 'Graded was administered to 
all third grade students in California' public schools- and equated to the 
Comprehensive Te.sts of Basic Skills (CTBS) . The same testjwas administered 
in 1980-81 and 1981-82. The median California student is estimated to be 
at the 60th percentile -in reading, the 56th percentile in written language, 
and the 55th in mathematics. w . .. 



Grade Six 



The performance of sixth graders*in California declined in the early 
1970s and leveled off by 1974. It has climbed steadily since then. . table 16 
shows that the median California sixth grade student's performance in 1981-82 
was slightly above the national sample tested in 1973 by the makers of the 
Comprehensive Tests of Basic Skills . Figure 31 is a graphic ( representation of 
these trends* Reading j>erfotmance ha? a percent ile^rank of 58; language, 57 
and mathematics, 58. ' 
& " r " . 

A more complete description of these findings is given below: 

■ ** , 

1. From 1969-70 to 1973-74 the Comprehensive Tests of Basic Skills (Form 
Q, 1968 norms) was administered to all California sixth grade students. 
During this period the performance of California students declined from 
fo ; ur to nine percentile ranks on the basis of the 1968 norms. 

2. *;In 1974-75 the first version of the California Assessment Program test, Che 

Survey of Basio Skills , was administered statewide. An equating study 
conducted that; year showed that scores had improved and that if the Compre- 
hensive Tests of Basic Skills had been administered statewide, the percen- 
tile ranks would have gone up to 48, 43, and 44 for reading, language, and 
mathematics, respectively. , 

3. A revision of the survey was administered in 1975-76, 1976-77, 1977-78, 
1978-79, 1979-80, 1980-81, and 1981-82. An equating study showed that on 
the basis of the 1973 ^fersion of the CTBS , California students improved 

** enough in 1975-76 to equal or exceed the national average in reading and 
mathematics. Following the upward trend of earlier years, the 1981-82 
improvement in language and mathematics achievement boosted the percentile 
ranks to 57 and 58 respectively. The percentile rank for reading moved up 
to the 58th percentile. 

r ' "* 

I < 

Grade Twelve 



The performance of twelfth grade students in California declined consis.- 
tently during the seventies* since testing began in 1969-70. By 1976-77 the 
median high school senior was at the 42nd, 33rd, and 43rd percentile ranks in 
reading, written expression, and mathematics, respectively, on the basis of the 
Iowa Tests of Educational Development witih ,its 1962 norms. On the basis of 
tests with more recent norms (1970) the ranks were even lower (see Table 17 and 
Figure 32). 

* 
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( "' • * 

** • » 
•Whereas progress in the last years was noticeable but spotty ; the gains 
made in 1980-81 wflf^jmor^ uniform and* substantial. Reading moved up to the t 
42nd, ?3^d, and 35Eh ^percentile ranks on the tests used to establish national 
Qompaxisons with 1962 and 1970 norms. Written expression scores moved up to 
35, 29, and 30. The improvement fit; mathematics w^s largest of all, increasing . 
'the ttetionajk percentile ranks t\p 46, 44,- and 47. 

The result^ for 19.81-82 were ^ixetU . Students improved in two of the areas 
(written language and spelling) and declined in two areas* (reading and mathe- 
matics). Since the changes in atwareas were quite small, onJ.y^one of the ' ' 
national percentiles was affected: reading moved from the 33rd to the 32nd 
-percentile rank on the Tesf:s of Academic Progress. r 

/Each of the three tests were renormed on new national samples in 1978. 
National performance declined during the 1970s. When California students are 
compared to this new norm, their relative standing is higher than when compared 
to the 1962 and 1970 national norm samples. 

Table 17 includes the specific comparisons with these more recent norms. 
It- can be seen that this decline in national performance gives California a 
higher standing in all but one case. The latest ranks place California stu- 
dents near but still slightly below the norms on. the STEP arffd thjj TAP. On the 
STEP, California is above the newer national averages in both language and 
mathematics. £ 

^ -t f • 

Scholastic Aptitude Test (SAT) Results 

The results of the California Assessment Program are the only indicators 
of the level of learning of all California public high school students. The 
'results'of the Scholastic Aptitude Test ,' a nationally administered college 
admissions test, however, have received considerable attention from the press 
over the last decade or so. Although the SAT results represent only a select 
sample of California students, they have followed a pattern similar to that of 
the CAP scores. They are presented here for the reader's' convenience in using 
both sets of results to judge the educational progress of high school students.^ 

There are a variety of advantages and disadvantages of employing the ^ 
SAT results as a basis for making inferences about the effectiveness of the 
"educational system.' The key point on the positive s.ide is that the test results, 
can be traced over a long period of time; although the 'test items are changed 
and updated, the common 200-800 score scale allows for valuable longitudinal 
comparisons. * . • j S" 

The chief disadvantage is that only a sample of all students take the SAT. 
The real problem in interpreting the scores is that one never knows how repre- 
sentative the California and national samples are. They obviously .are not 
representative of all students, and they may or may not be representative of the 
college-bound population.- In California about 36 percent of the seniors take 
"the SAT, whereas nationally about, 33 percent are tested. Equally important is 
'the fact that the test reflects almost exclusively the more advanced, higher- 
level thinking skilly in the areas of language arid mathematics. This is, of 
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Comparisons with National Norms 

course,) yery logical given the purpose of the test — to/predict how well students 
will .succeed in college. It just means that one camion judge, from this infor- 
mation, the total effectiveness of schools «in reaching their various aims, 
especially as those aims pertain to the other two-fthirds of the .high school 
population. ' . f „ ' • # " 

Figure 33* shows the national trends for. the verbal and mathematics parts of 
the SAT going back to I960. Table llf, gives tile specific scores. It* can be seen 
that the much-publicized decline began in 1963. Test results "for individual 
states became available from the College-Board . in 1972. Figure 33 also shows 
the trfend for California seniors since that time. It can be seen that Califor- 
nia seniors were above the national Average (but not necessarily all other 
states) in the early seventies but were declining more rapidly than the rest of 
the United States. * , ' ' 

During the mid-seventies, both California and the national average began 
tQ level off. In 1978, the ti^end lines began to diverge again; the national 
average was still slowly declining, whereas the California trend line moVed 
clearly above the national average in math (to a nine-point le&d in 1981) and 
slightly above on the verbal part (a two-point lead). * 

In 1982, the' national averages improved for the first, time in 19 years; 
one point in mathematics and two points on the verbal part of the test. The 
California gains were not maintained; the averages declined one point on each 
pa$t ofc^ the test. Chapter VII contains additional information related to the 
SAT results for California students. 
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• TABLE 15 . 

ESTIMATED NATIONAL PERCENTILE RANKS OF MEDIAN CALIFORNIA PUPIL PERFORMANCE 

1966-67 THROUGH 1981-82 



Grade Three 



Qontent 


' Stanford Reading Test 


'Teat 

LuopernL lvc 

Primary* 
Reading Teat 

1971-72 1972-/3 


. adminis 

Reading 
, Testa 

1973-74 


tered 

Reading Teatb 
(Reviaed) 

1772T-75 197^-76 1976-7/ 1977-7H iy/U-/¥ 


Survey of 
Basic Skillac 

1979,80 19BU-H1 19B1-H2 


area 
Reading 
Language 
Mathematics 


■ 34 * 34 . 36 36 38 

— r - : f * . ' — 


52 . $2 
**" 


52 


55 55 56 57 58 


58 59 60 
• 

53 .54 56 ' 1 
51 52' 55 


Norms: 


„, Stanford, 1963 norms ' 


CPRT, 1966 norma, 


CTBS, 1973 norms 



aThe Reading, Teat waa first administered in 1973-74. The percentile ranka are based on an equating of the Reading Teat and the 
Cooperative Primary Reading Teat , forms 23A and 23B, wormed in 1966. 



bThe revised Reading Teat w»a adminiatered to all California students in ?^5 f 1975-76v 1976-77, and 1978-79. The Percentile ranka 
are based o n equating, stu dies of the reviaed Reading Test anoVthe Comprehensive Teats of Baaic Skilla, Form S, normed in 1973. 

cThe new Survey of Basic Skills: Grade 3 waa administered- tp all California stu 
percentile ranks are baaed on an equating atudy of the n^tfsat, and the Compreh 



students in 1980-B1 and 1981-82, The eatimated national 
enaive Teata of Basic Skills, Form S, normed in 1973. 
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66-67 67-68 68*69 69-70 70-71 71-72 72-73 73-74^74-75 75-76 76-77 77-78 78-79 79-80 80-^ 81-82 ¥ 
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Key: 



O Stanford Achievement 7«7Tl963 norms) • 
A Cooperative Primary Reading 7«f J (1966 norms) 
X Reading Tests— -equated to CPRT (1966 norms) 
□ Reading Test (Revised)— equated, to CTBS (1973 norms) 
0 Survey of Basic Skills: Grade i-<quated to CTBS (1973 norms) 



,Fig. 30. National percentile ranks of median third grade California student performance, 1 960 67 through 
1 981*82 for reading and 1979-80 through 1981-82 for' written language and math 
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' \ TABLE 16 

ESTIMATED NATIONAL PERCENTILE RANKS OF MEDIAN CALIFORNIA SJUDENT PERFORMANCE 

■ 1969-70 -THROUGH 1981-82 



Grade Six 

Test Bdministerea" 



Content 
greg 



Comprehan8ive Test of Basic Skills 
1969-70 1970-71 1971-72 1972-Vj Wli-W 



Survey 
of Besic, 



Skillsa 



Survey of Bae^fc* Skillsb 
Wb-ih 19/6-77 i9/t/-/p 19/8-/9 19 79-Mu 19UU-yr 



Reading 

Language 

Mathematics 



48 


46 


44 


44 


44 


43 


43 


39 


39 


37 


47 


• 43 


. 38 


38 


38 



48 
43 
44 



53 


53 


55 


55 


56 


57 


58 


49 


51 


51 


52 


53 


55 


57 


50 


' 51 


•53 


54 


55 


56 


58. 



Norms: 



CTBS, 1968 norms 



CTBS, 1973 norms 



«The new California' test, tha Survey of Basic Skills: Grede 6 , was first edministered to all California W" 8 . ta^WS. 
The percentile renks ere based on an equating or the Survey of Besic Skills end the Comprehensiv e Tests of Besic Skills vCTBS./, 
Form Q» which was normad in 1968. 

bThe revised version of the Survey of Besic 'Skillst Grede 6 t wes administered from 1975-76 through 1980-81 . A second 
revision of the test was edministered in 1981-B2. Iha percentile ranks ere based on equetings of the revised versions of 
the Survey of Basic Skills and the Comprehensive Tests of Besic Skills ( CTBS ), Form S, 1973 edition. * 



n4 




O Comprehensive Tests of Basic Shifts U96H.no/msJ 
□ Comprehensive Testf ofjtesic Slc'ttlfl^sh norms) 



^ Fig. 31 . National percentile raqks pf median sixth grade California student performance 1 969-70 through 
* 1981*82 ' > *' " v 
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TABLE 17. , 

¥ 

ESTIMATED NATIONAL PERCENTILE RANKS OF MEDIAN CALIFORNIA STUDENT PERFORMANCE 

1969-70 THROUGH 1981-82 

Grade Twelve * - 





Test administerecT" 


f 


Iowa Tests* of Educational Development 


Survey 
of Basic 








4 










rorm a, normeo in lyoc 


oKilisa 






Survey of Basic Skillsa (Revised) 




Content area 


1969-/1* 1VJU-71 , 1971-72 1972-73 1973-74 


1974-75 


197t>-76 


1976- 


77 1977-78 


1978-/9 


19/9-HU 


1980-B1 


1981-82 


* Reading 




















I TED, 1962 norms 
1978 norms 


52 49 49 47 47 
• 


41 


-43 


42 


'42 


• 41 


41 


42 

\44 


42* 
44 


TAP, 1970 norms 
1978 norms 




33 


35 


33 


32 


32 


32 


!.3J • 

;42 


A2 


STEP, 1970 norms 
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BThe new California test, the Survey tff Basic Skills; Grade 12 , was administered to all California students from 1974-75 through 
1981-82. The percentile ranks are based on equating studies of the Survey of Basic Skills and three other tests with national norms: 
(1) Iowa Tests of Educational Development , normed in 1962 and 1978; XT) Tests of Academic' Progress , normed in ,1970 and 1978; and (3) 

. the Sequential jests of tducational Progreaa^ normed in 1970 and 1978. 
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Fig 32 National percentile ranks of median twelfth grade California student performance, 1969-70 
through 1981-82 

i 



149 



15. 



* 



TABLE 18 



SCHOLASTIC APTITUDE TEST SCORES (SAT) 
1971-72 THROUGH 1981-82 
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VII. Time and Learning in fcalifornia Schools 



v , Synopsis of findings ■ , 

Total instructional time in California is the equivalent of: 

- One-half year less than nationwide by the end of grade three.; 

- Orte and one-third years less thai? nationwide by the end of high school. 
Iri grade six, of the five hours of 'total instructional time: \ 

i , • ; 

- Half is spent on the basicfc: reading (61 minutes), writing/)anguage 
(47 minutes) , and mathematics (53 minutes) ; " • \ 

- One-fifth is spent -on science (25 minutes) 'and social studies (36 minutes), 

'More time is spent on reading in schools serving low socioeconomic popula- 
tions, and this time is taken away from writing/language, science, and social 
studies, but tiot from mathe^^ics. ' 

High school seniors, over their four years of high school, average 3,8 years 
of English, 2.8 years of mathematics, 2.1 years of science, and 1.5 years of 
foreign language instruction. 

Twenty-nine percent of high school seniors have had no foreigrf language 
instruction. 

National achievement data suggest smal 1 advantages for California students 
in basie reading and mathematics skills and in initial college preparatory 
mathematics. 

*■ 

The number of science and mathematics courses taken by college-bound high 

school seniors in California is far under the average for high school seniors 
nationwide. 



Although California seniors take the %Scholastic Aptitude Test ' at the same 
r&te as seniors nationwide, they take the achievement battery at a much 
higher rate* However, they take the science achievement test at less than 
half the national rate.' This reinforces the findings on differences in 
course taking. ^ t 

Achievement levels in biology and chemistry among college-bound high school 
seniors in California fall below national levels even after accounting for 
the more highly selective course entry! 
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Time and Learning in California Schools 



Introduction 

A recent survey of elementary and secondary schools by a California school 
superintendent (Anton, 1981) concluded that California pupils are offered less 
schooling than pupifs nationwide. This finding stirred concern because of 
its obvious implication, that less schooling results in lower achievement. 

The annual reports of 'the California Assessment Program have presented 
information to educators and policymakers on a^ variety of factors associated 
with school success, most notably and recently" 4 , the relationship between 
television viewing and achievement. This practice helps fulfill one aspect of 
the legislative intent of the testing program: "The program of statewide 
.testing shall "identify unusual . success or failure and the factors which appear 
to be responsible, so that appropriate action may be taken at the district and 
state level to obtain the highest quality education for all public school 
pupils." (Section 60601) The focus of this' year's report will be upon the 
amount and use of instructional time in California schools. 

' "The search for effective schools and the identification of their common 
(causal?) characteristics has been widespread and fruitful. One summary of 
the common elements found in schools which seem to produce consistently higher 
achievement* than their peers is given in the appendix to this chapter. 
The characteristics listed fit the common sense notion of what "good schools, 
or other social institutions, are like. The problem is one of replication-; 
how can other schools be helped to fallow their lead. Many, if not most, of 
their characteristics are related to the personalities of the people involved; 
Personalities are not easily changed. 

The recent focus on instructional time and its transformation into 
"active learning time" or "time-on-task" has provided policymakers a tangible 
and potent lever for improving .school achievement. Time is the portal through ■ 
which all learning must pass an£ all resources and efforts aimed at improved 
learning' must directly or indirectly impinge on learning time. 

Tf it is tru6 that California pupiij*have shprter school years and 
shorter school days, then there is less time to learn and consequently pupils 
.will achieve' less. This argument tacitly assumes that learning time made 
available to pupils is relatively homogenous in content and -productivity. 
That is, it assumes that an hour of schooling generally results in a similar 
amount or learning nationwide for comparable pupils. That assumption could be 
justified if resource allocations and uses in the nation's schools were quite 
similar, so that teaching-learning processes in particular grades would show 
only negligible variations nationwide. But actually, this is not the case. 

' Typically, resource allocation is measured in terms of per student 
expenditures and resource use is. characterized by indicators representing 
the organization of schooling, such as school and class size, teaching stra- 
tegies, and curricular policies and* goals. All of these factors vary widely, 
and they do matter for student .learning. They strongly influence the major * 
vehicles carrying students' achievements, i.e., the amounts and contents of 

their active learning time. r 
i * 
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It is beyond the scope of this chapter to present a comprehensive picture 
Of the productivity of California schoole. Such an analysis would require. ' 
much more data, for California and the nation, than is now available on the 
variety of ways- that different types and levels of resources are allocated 
to various kinds of goals for different types of students. It is hoped that 
the information in this chapter will, however, provide useful, albeit limited, 
information about the allocation of one scarce resource: time, and how 
California schools compare with the nation ift their handling of, 
that resource. ■ | # 

Designed to accomplish this goal, the chapter is organized in the following 
"sect ions : 



A review of the research fQcus on instructional time and, active 
learning time; r 

A comparative analysis of the amount of time allocated to learning 
in California schools; 



• An analysis of ho.w that time is allocated to different subject 
areas and courses; ■ ' 

* 

• The relative impact on student achievement of those time alloca- 
tion patterns and; 

• A brief discussion of some ways that-California student achieve- 
ment can be raised. 



Instructional Time and Active Learning Time 

♦ 

The past ten years of research on schooling have strikingly shifted atten- 
tion 'toward the uses of resources — especially teaching time — and their conse- 
quences for learning (see Wiley and Harnischfeger , 1974). Much of the conceptual 
underpinnings of this work are due to Carroll (1963) and have been extended by 
Bloom (1976) and Harnischfeger and Wiley (1|976, 1978, 1983). Important empirical 
results as well as conceptual summaries may be found in Denham and Lieberman 
(1980) and Fisher and Berliner (1983). 

Key words and phrases that are used, especially in the empirical literal 
ture, to describe students* relations to the teaching-learning process include 
"on-task - off-task," "engaged 1 —unengaged/ 1 "attentive - inattentive," and 
'"active «*• inactive." These terms are attempts to invoke the psychological 
precept that in order to learn, an individual needs to respond actively, funda- 
mentally, this^notion is based on the conception that all learning consists of 
acquiring capacities to perform tasks. When learning is intentional, these 
capacities are often acquired by practicing and mastering those tasks, or sim- 
plified verpiotfs of them or parts of them (subtasks)* Such tasks are usually 
then called "learning tasks." Learning tasks, as any other tasks, must be "per- 
formed" and,' therefore, • activity by the learner — in some* formr- is mandatory. 
To paraphrase Tyler (1949), to learn to do, one must do. 



Time and Learning in California Schools 

Thus, active learning time, t ime-on-task, or engaged learaipg time, and re- 
lated terms such as academic learning time, opportunity to learn, and allocated 
learning time, Have become concepts that have redirected much of the earlier re- 
search on school and teaching effectiveness to focus on the •teaching-learning 
process and its determinants. This research has led to' one simple but profound 
insight: A student's time'-on-task, or active learning time, determines his or 
her ^ achievements. ' 

m This research implies that there are only four ways to increase achievement 

(Harnischfeger and Wiley, 1983). One is via a reduction in the time needed to 

learn. All the others depend on increasing active learning time. These latter' 
three routes consist of: 

• Increasing the total artioiint of time allocated to learning; 

• Increasing the portion of that allocated time that is actually allowed 
for learning; # 

• Increasing the amount of this allowed time that students actively devote 
to learning- / 

The primary 1 focus of studies of total school time — day length and year 
length — is on the quantity of time available, not its use.^ The use of that 
time determines what is learned and "how it is learned, thus^irectly influenc- 
ing active learning. This total time is allocated to part/lcular subject areas, 
learning topics, and learning tasks.. Only the time made aValTatFibe. for these , 
activities may be used for learning, and .time not- available for learning can 
never result in actual learning. 

Are California Studertfs Offered Less Time to. Learn? 

pie results of Anton 1 g survey may be disregarded if their accuracy is in . 
question. If, however , ' Anton' s results are supported by other data , collec- 
tions of known accuracy, 'then the implications of less school time to learn in 
California are worthy of consideration. 

Anton's estimates of scheduled instructional time are compared^ to those 
found in a national study of known high accuracy (National Institute of Edu- 
cation,,* 1978). These 1976 data closely correspond to Anton's national time 
estimates (Table 19), as does CAP's sixth grade survey, made one year later than 
Anton's (1981-82 vs. 1980-81)* CAP collected from school officials information 
on subject-matter time allocation, as well as On practices and policies' concern- 
ing time allocations. CAP's data collection resulted in an even slightly lower 
estimate of instructional time allocation than Anton's. Sixth graders' daily 
scheduled instruction is estimated as slightly greater than five hours in 
Anton's 1980-81 survey (308 minutes), while the average is just about five 
hours (299 minutes) in the 1981-82 CAP Survey. 

A compatison of CAP's estimate for $ixth graders in California to Anton's 
1980-81 nationwide estimate, with consideration given to the shorter school year 
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in California, shows that sixth graders in California are offered 93 hours less 
schooling than sixth graders nationwide. 1 This is -equivalent to 19 instruc- 
tional days, or nearly one month of schooling. 2 This difference i,s substantial 
and consist.ent~the daily scheduled instructional times for all grades in Cali- 
fornia are systematically shorter than those in the nation as a whole.' 



Table 19 ' 

Mean Daily Minutes of Instruction and Length of School Year 
; for California and the Nation, by Grade 



Grade 


A 

Nation 


California 


1975-76* 1980-81** ' 


1980-81** 1981-82*** 


K 
1 

2_ 
3-*~ 
4 
5 


203 191 
304 310 • 
308 311 
311 314 • 
321 322 
323 323 


182 
268 
268 
270 
303 
304 


6 - 


. 329 326 


308 299 


7 
8 
9 
10 
11 
12 


349 ' 332 

350 333 
331 
332 
331 

> ' 331 


308 

309 

302 

305 . 

305 

305 


Days per ye^ar 


177.5 178.5 


176.0 


♦National Institute of Education, Compensatory Education Study, 
unpublished tabulations. 
**Anton data. 

***California Assessment Program, Grade Six Survey, 1981-82. 



California high school student's also receive less schooling because of 
fewer periods per day\and a shorter school year (Table 20).. In e*ch year^Tf high 
school, students in' California, on the average, take 73 hours less coursework^ 
than students in the nation as a whole. This is equivalent to 13 school days 
in California. Thus, over four years of high school, California high school 
students receive the equivalent of 51 days, or about two and a half months, le$s 
schooling than high school students nationwide. 



Total hours are calculated by taking the product of the minutes per day 
and days per year and dividing that product by 60. This process was carried out 
for sixth graders in ^lifprnia and the nation, using the figures in Table 19. 
The resulting discrepancy 'is $3 hours. 
2 . V~ 

Ninety-three hours divided by five hours per day (299 minutesl equals 
19 days.^ * H 
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. % Table 20 

High School Instructional Time, California and^he Nation, 1980 





Time Component v 


California ' 


\ Nation. 


1. 


Minutes per period " * 


54.1 


\ 52.1 


2. 


' Period3 per day 


6.1 




3. 


Minutes per day l(l)x(2)] 


' 330.0 


349.^ 


4. 


Days per year 


177.3 


180.1 


5. 


Hours per year* [ (3)x(4)-r60] 


975 


■ 1048 



* Tot al High School Instructional time in California is 7.0 percent less 
than that in the nation according to data from High School and Beyond . 
According to the Anton survey (Table 19), the corresponding shortfall is 
9.2 percent. 



Hypothetically, a typical California student's school life, as exhibited 
in Table 19, from kindergarten through twelfth grade would be 72,000 hours 
shorter than that of a typical student in the nation; this is thefequivalent 
of one and one-third sixth grade school years. This large discrepancy is the 
result of shorter instructional days and a shorter school year. California 
ranks among the ten states with. the shortest school year in the nation (§igest 
of Education Statistics, 1980). 



The extent of the differences in amount of schooling shows that rela- 
tive to the nation, the instructional days in California are especially short 
in the primary grades (K-3). By the end. of grade three, California students 
have been offered one-half year less schooling than students nationwide. The 
yearly discrepancies in later grades are somewhat smaller', but they consistently 
increase the cumulative shortfall.. The question remains whether California 
students achieve less than students nationwide or whether the learning pro- 
ductivity per time unit is higher in California than nationwide, assuring 
equivalence of student achievement. A comparison of subject-matter time 
allocations clarifies how students spend time in school, and a comparison- of 
achievement test scores c^Calif orni^ students to those of students nationwide 
will serve to subs tantiatfe the discussion. 



How Much of What Are California's Schools' Offering? 



terparts 

re with those 



California students spend less time in school than their co 
nationwide. But how do learning opportunities in California com 
of schools across the nation in terms of subject-matter time al Vocations? Data 
from the 1981-82 assessment of California sixth graders were compared with data 
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from a national study carried out in 1976-77 (Hinckley et al. # 1978), and 
1981-82 twelfth grade CAP data from student reports on high school courses taken 
were compared to national data collected in 1979-80 ( High School 'and Beyond) . 
CAP has further compared California college-bound seniors to college-bound 
seniors nationwide for the pa^t ten .years—the dollege-bound^def ined in this^ * * 
chapter , as those who took the ^holastjc Aptitude Testf»(SAT) . 

In an evaluation of these comparisons, it is important to 'recall that the , 
.process by which time is used differs from elementary to secondary schools 
because of their different organizations* Instruction in elementary schools, 
especially in the lpwer graded takes place primarily in self-contained class- , 
roomSyj^H^TeTT a single teacher arranges times and sequences of instructional 
activities. Students are typically grouped for instruction, and the major 
allocation decisions about how much ifime to devote to a particular subject £rea, 
for a specific group or individual, are left .to the teacher in charge. As 
expected, wide variations .result across classes .(DeVault , Harnischfeger , and 
Wiley, 1977). * N * ' - 

On the other hand, secondary schools and the upper grades in some elemen- 
tary schools are departmentalized. This means that the teacher, a§ an i'ndivid-' 
uai, has no control over the gross time allocations for subject areas. Thus, 
tfie district and school, by means of course offerings and entry and* counseling 
policies, and the pupil and his or her parents, by . their qhoiceV within these 
t policies, influence the allocation and use of instruct idttal time. 

Sixth Grade, Subject Area Time Allocations ' * 

The sixth grade time allocations to subject areas* are displayed in Tables 21 
and 22. Table 21 exhibits national data/ on minutes per day of ins pxx£t ion offered 
in reading and mathematics in grades one through six in-1976-7? (Hinckley et 
al., 1978). The data indicate that, nationally the number of minutes per, day of < 
reading instruction decreases subs tantially^ahd continuously frota grade one 
(about, one and three-fourth hours) to grade six (about 1 hour). The California 
data for grade six match those for the nation. ■ In mathematics, the" national • 
data are essentially constant (at about an hour per day) across the elementary 
grades. California mathematics instruction, contrary to the finding for reading, 
may be shorter than the national\ aye rage in. the 'sixth grade — 4 miriutes-, or 7 per- . 
cent, less* ' . * - 

Table £2 shows that in grade six' in California the basic .skills areasr- 
reading (61 minutgsjLi gfc&iiig/ language (47 iyfnutes), and mathematics (53 
minutes) — have the largest time allocations* each' approaching an hour on the 
average. These arm followed, by social studies C36 minutes), physical - education 
(27 minutes), and sfcience (25 minutes). Art, music, and health trail with about 
a quarter of an how each. In total, the average instrCictioittal time per day is 
reported as* about 5 mours,^ and nojiinstructional time (recess, lunch, and so oh) 
is reported at about 1 hour, yielding a total school day of about 6 hours. 

These 'time allocations are averages in two senses. First, they are the 
•assessment; of a school- principal or other school official of the typical daily 
time spent on these subject areas. In a sense, these are "average" values over 
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- ^ , ' > . Table 21 ' « 

Mean Daily 'Minutes of Instruction in Reading and Mathematics/ 
Nationally, by Grade, and California, for Grade Six 





• * 


>/ ^\ Reading 


Mathematics * ' 




etade 


Nation California 
'(1976-77)* <i981-82)*£' 


• ' Nation California 
' (1976-77)*. .(1981-820** 


* * • 

\ 

1 

f 


' 1 
2 
3 

. 4 
./ 5- 
6 


100 . " ' -* ! ^|J 

86 • • - 

, 73 - • i * 
68 . • • - 
' ■ < 62 . • 6-1 


58 - - 

59 

61 

61 - _ - 
57 .53 

• • * 


f 


★Adapted from Hinckley et al., 1978. 
. **California Assessment Progranl, Grade Six 


Survey, 1981-82. 


> 




4 





Table 22 

r 

Mean Time Allocations, by Subject Area, 
in California; Grade ,Six, 1981-82 



Subject area 



Mean minuteg per day 



Reading / 
Writing/ language 
Mathematics 
-^Science 
Social studii 
Art 
Music 

Health ; 
, Physical education 
0ther 

„ . Total 

Total instructional time 
Total noninstructional time 
Total school time (sujn). 
School day length* , 



- 61 

47 
53* 
< 25 
36 

' 14 
• ' 16 
27 
■'7 
302* 

299* 

' 67 
. 366 
365 



'♦3, 



*The sum of the mean? does not equal Jthe mean of the sums, because of 
adjustments £ot outlying < obviously ineorrect) values. 
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different school days and over different school classes. Some of f this vari- 
ation is reflected Jn Table 23: About one half of the schools report that 
there is little or no variation in subject area time allocations. This 
report- differs, however, depending on school organization. About three 
quarters of schools with completely departmentalized sixth grades report 
lack of variation. Logically, £he remaining variations in these schools 
must be over school days rather than classes. 



Table 23 



Organization* of Sixth Grade, Classes in California 
and Reported Variation in Time Devote 
to Subject Areas, 1981-82 



Reported variation in 
time' devoted to subject 
areas over classes 


Percent, of schools by organization of 

sixth grade classes < - 


Modified ^ , , 
Self- self- Partially Completely 
contained contained', depart-.. depart- All 
classrooms classrooms mehtalized men'talized schools 


* • » 

Very much 
Some 

Little or none 
Not sure 

Wide variation in stome 

subjects, not in. others 
Only one class per grade 


.1 1 1 0,1 

3$ 31 25 14' 34 
46 58 65 .76 52 

l * l , * l q l 

4 «5 4 ' ' _ 4 4 
9 4 -4 / ' 6 8 


Total 

Percent of all schools 


\ 

100 100 100 100 100 
59 . 23 | 15 ■ 3 • 100 


4 ' > 



Data collected from teachers in other studies (DeVault et al., 1977; 
Denham and Lieberman, 1980) indicate that the principals 1 estimates might 
understate the actual variation — especially the figure of 46 percent- for 
schools with self-contained classrooms. These other studies, which include 
data from California and other states, indicate that basic skills tj.me 
^locations may differ by thrfee- or four-to-one across self-contained classes 
ip the same sphool. • * 

But equality of subject-area time allocations over daises is not neces- 
sarily a policy goal in itself', although mapy districts have such policies in 
the form of weekly time allocations to subject areas. These policies that, 
define content and/or time allocations obviously are bq&ed on the assumption 
that equal learning results from equal amounts of instructional time for all 
students. That, of course, is unwarranted. Vt would be preferable to discuss 
subject-area time allocations in the corttext of educational adequacy; i.e., 
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• ' i 1 

goals of schooling and resources available for specified groups of students. 
Subject-area time allocations would then be part of the resource allocation 
process, with students' and schools' educational difficulties being taken into 

account. ' 

i 

\ In fact, instructional time allocatipns vary for students with different 

' socioeconomic backgrounds (Table 24). , Using CAP's socioeconomic status (SES) 
index, we have assessed the sixth grade time allocation data for schools with 
very low typical, and very high socioeconomic student backgrounds. We have 
compared'subject-area time allocations for reading, writing/language, mathe- 
' -jiriitics, science, and social studies. Although the total amount of time allo- 
cated to these subject areas is the same for all schools, there are sizable 
differences among types of schools, by subject area. These differences' 
ar'etiacgest for reading. , 

Table, 24 

Time Allocations Across Subject Areas for California Schools Serving 
Communities of Different Socioeconomic Levels, Sixth Grade 







Instructional time (minutes/day) 




SES 

percentile 


Reading 


Writing/ 
language 


Mathematics 


Science 


Social 
studies 


Total 


10 
50 
90 


63.0 
60.1 
57.4 


44.9 
46.1 
•47.8 „ 


56.0 
55.9 
55.7 


25.9 
26.6 
27.2 


35.5 
36.4 
37.3 


225 .3 
225.1 
225.4 ' 


Difference 
(10 vs. 90) 


+ 5.6 


- 2.9 


+ 0.3 


- 1.3 


- 1.8 




Percent 
difference 


+ 9.3 


- 6.3 


+ 0.5 


- 4.9 


-"5.0 





Schools serving communities of low socioeconomic level (those whose 
levels exceed only the lowest 10 percent) allocate the largest amount of 
time to reading (63 minutes per day). Students in these kinds of schools are 
offered 9 percent more reading instruction than students who are enrolled in 
Schools in communities of high socioeconomic level (those whose levels are 
exceeded by only the highest JO percent). Since the total time allocation to . 

the. above-named subject areas is^the same for all schools, the 'extra reading 

time must effect a shorter time allocation , in other subject areas. Obviously, 
mathematics time allocation is not cut. But an increase in time allocation 
to reading tends to decrease the time allocations to .writing/language , science, 
and social studies, but not ,to mathematics. 
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• t ' 1 

As a part of the supplementally questionnaire, sixth grade principals also 
indicated their concern for how instructional time is to be used to increase 
students 1 active learning time via a number of strategies and special programs 
they have iitfplemented'. CAP's data show that over 80 percent of the schools 
have some kind of program that is specifically directed toward increasing 
students' active learning^ time (Table 25). The most common strategies used 
involve regrouping students (65 percent), improving disciplirie (76 percent), 
staff development (55 percent), improving students' independent work habits 
(51 percent)/ and providing better material^ (51 percent). 

» 

Table 25 



Use of Special Programs and Strategies 
in California Elementary Schools 
to Increase. Time Devoted to Instructional Activities 





percent of schools 




using programs 


Program strategy 


extensively 


» Making new student groupings 


■ 65 ' 


Increasing direct teaching 




Iricreas^ing or Redirecting aides' % , 




Providing, better materials 


51 


Improving discipline 


76 


Reducing class size 


15 


* Changing school schedule 


36 


Increasing parent involvement 


36 


Changing classroom schedule^ 


38 


Changing, physical arrangements 


24 


Decreasing seatwork 


- • 21 


Providing .staff development 


, 55 


Improving independent work habits 


51 


■ Providing for cooperative learning 


* 


arid peer teaching * 


37 _ 


Total 

* : > : 


81 



Some of the strategies used or favored by principals involve redirecting 
resources; olhers require additional resources. Reducing class size and 
increasing parent involvement and staff development require , supplementary 
re$ource$; making new student groupings, increasing direct teaching, and 
changing classroom schedules are examples of redirecting resources. 

The empirical and theoretical literature bearing on increased -active 
learning time implies that augmenting teacher-student contact is the most 
direct means. This is primarily achievable by reducing seatwork. With fixed 
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resources, however, this can only be accomplished by , increas ing , rather* than 
decreasing, group sizes, since a student's seatwor.k usually occurs when the. 
teacher is meeting with a group to which the student does not belong. 
Another favored strategy — improving students 1 independent worl^ habits — woald 
surely enhance the amount of active* learning time during seatwork, but at 
this* time there are no proven ways of accomplishing it. 



High School Courses Taken 

Far high school students, it was feasible to look beyond subject-area 
time allocations or course offerings to actual courses taken ^from the ninth 
grade through the end of the twelfth grade. CAP has analyzed courses taken by 
all high school students and also for a special subgroup, the college-bound 
seniors. 

Table 26 exhibits average coursework of California twelfth graders from 
the ninth through twelfth grade in several subject areas. Students take more 
English than any other type of coursework. The average number of years of 
English taken is 3.8. This is followed by social studies (3.1 years), physical 
education (3.1 years), mathematics {2.8 years), science (2.1 years) and foreign 
language (1.5 years)*. Twenty-nine percent of California seniors report no 
foreign language coursework in high school. 

Table 26 

Percent of California High School Seniors Reporting 
Various -Amounts of Coursework, by Subject Area, 1981-82 - 



— ^ — * 




















'Percent 


of 


students , 


by number • 




Mean 




of 


years of 


coursework 


Subject area 


years 




1 


,2 


3 


4+ 


Total 


English 


3.8 


0 


1 


3 


22 


74 


100 


Mathematics 


2.8 


, o 


9 


30 


32 


- -29 


. 100 


Science 


2.1 


1 


33 


36 


20 


10 




Social s tudies «• 


, 3.1 


1 


6 


15 


41 


37 


100 


Foreign language 


1.5 




21 


31 


13 


6 


100 


Physical education 


3.1 


1* 


'2 


24 


33 


40 


100 



On the other hand, 74 percent report taking four or more years of English* 
The percent of students reporting similarly high levels of courses taken in 
other subject aread is substantially lower— phys ical education (40 percent), 
social studies (37 percent)-, mathematics (29 ( ^percent ) , science (10 percent), 
and foreign language (6 percent). 
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j Only 1 percent of California seniors t'akte four or more years each of 
English, mathematics, science, and foreign language. Even when the criteri< 
•is aropped to three years of science and foreign language but four years 
of English and mathematics, only 5 1/2 percent of 'California high sctiool 
seniors report taking that amount of higher level academic coursework. 

Comparing the California data on^ourses taken to national data is 
difficult for two reasons. Purely statistical national data on courses taken 
are based on institutional reports that yield enrollment rates for particu- 
lar courses but do not link aggregate course registrations to the in- 
dividuals who produce them (Ostendorf, 1975). Also, since these surveys 
cover single years; it is impossible to estimate cumulative years of course^ 
taken in terms of the percentage of individuals with zero, one, two, and so 
'on, courses^or years of coursework. Survey data on high school students, such 
as those from the National Longitudinal Study of High School Class of 1972 
and High School and Beyond , are potentially comparable dati, but in both cases 
the data were collected for the last three rather than the last four years of 
high school. 

♦ 

One approximate comparison, however, is presented in^Table 27. Essential 
all California high school students take at least one year of mathematics. By 
assuming that students take their first (or only) math course in ninth grade, 
CAP derived twelfth grade data that are in line with those of High School and 
Beyond. It can be seen from Table 27' that California levels, of mathematics 
coursework are' similar to, but slightly less than, those across theuiation. 



Table 27 

Percent of Twelfth Graders Reporting Specified Years 
of. Mathematics Coursework- Taken in the Last Three Years 
of High School, 1979-80 and 1981-82 



Years of mathematics 


1979 


-80* , - 


1981-82** 


Nat ion 


California 


Cal if ornia 


0 


7.8 


9.7 ' 


. 8.6' 


1 


27.3 


32a 


30.1 


2 ... 


4+ 33.5 


32.6 


32.1 


3 or more 


31.4 


25.6 * 


29.2 . 


Total 


100.0 


\100.0 


100.0 -„ 


Median years 


1.44 


' 1.25 


1.35 



*These data "are 'derived from the High School and Beyond survey * 
conducted by the National Center for Education Statistics in 1980. 
**These figures have beeh adjusted to reflect the fact that the High 
School and Beyond survey inquired only about the final" three y^ars o 
high school and that essentially all California students take at lea 
one mathematics course • Thus, the values have been reduced by one 
year. ' - * 
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Student enrollment in mathematics and science. Each October for the last 
two yeafs each California high school teacher has completed a Professional 
Assignment Information Tonn as part of the statewide information collection 
system known as the California Basic Educational Data System (CBEDS) . On this 
form thiy indicated the number of students in each course they teach. 

Tables 28 and 29 present the number and percent of students in grads^.9-12 
enrolled in mathematics and science courses. It can be seen that the numbers 
are quite similar from 1980-81 to 1981-82; however, the overall Wantage of 
students enrolled in mathematics courses. decreased while there was a slight 
increase in the percentage of students taking science. 



Table 28 

Student Enrollment in High School Mathematics Courses* 



Course 



1980-81 



1981-82 



No. of', 
students 



Percent of 
students** 



No. of 
students 



Percent of' 
students** 



General Mathematics /Basic 
Consumer Mathemat ics /Senior 
Remedial Mathemat ics«/Math Labs 
Beginning AJgebra 
Intermediate Algebra 
Plane, Geometry 
Solid Geometry 
Trigonometry 

Intermediate Algebra /Trigonometry 
Solid Geomet; y/Trigonome try 
Probability/Statistics 9 
Modern Algebra 
Computer Programming ^ 
Advanced Placement Mathematics 
Analytic Geometry/Pre-Calculus . 
Calculus 

Mathematics, Gifted and Talented 
Other Mathematics Course . 



184,138 
59,339 

177,660 

248,433 
54,p80 

119,089 

3,486 

14,170 

*33,498 

J, 257 
... 1<q5 

12,862 
.12,548 

4,245 
11,35-8 

4,577 
12,683 
■ 82,756 



14.0 
4.5 
13.5 
18.8 
4.1 
9.0 
.3 
1.1 
2.5 
.1 
.0 
1.0 
1.0 
.3 
.9 
.3- 
1.0 
6.3 



TOTAL (General, Consumer 

and Remedial Mathematics) 

TOTAL (All. mathematics courses 
other than General, 
Consumer, and Remedial) 



421,137 ^32.0 



615,237 



46.7 



167,982 
49,256 
148,711 
239,485 
54,021 
116,059 
3,759 
15,663 
33,538 
979 
, 235 
8,522 
18,284 
•4,184 
- 11,607 
6,078 
11,37.3 
97,393' 



365,949 



621,180 



.13.2 
3.9 
11.7 
18.8 
4.2 
T.l 
.3 
1.2 
2.6 
.1 
.0 
0.7 
1.4 
.3. 
.9 
.5 
.9 
7.6 



28.8 



48-6 



GRAND TOTAL 



1.D36.374 78.7 987,129 



77.4 



*Taken from California Basic Educational Data System (CBEDS) 
**Based'on the total number of students enrolled in high school (grades 9-12) 
1,318,713 for 1980-81 and 1,276,368 for 1981-82. ' 
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Tfcfele 29 



0 







• 

1 




> 


Student Enrollment 

' * 


in High School Science Courses* 






1980 


-81 


1981-82 


» \ 


No, of 


Percent of 


.No. of 


Perpent of 


Course 


students 


student^** 


students 


students** 


Astronomy ■ « 


2 ,202 


• 2 


2.59S 


.2 


Aerospace Education 


3,352 


.3 


3,536 


.3 


Aviation Education 


1 ,683 


, .1 


1,488 


.1 


Biology , • t 


192 ,743 


14,6 


180,768 


14.2 


Advanced Biology 


1 /. TOC' 

14 ,785 


1,1 


H ,932 


.9 • 


Botany 


1 /. Q Q 

1 ,49o 


• 1 


2,041 


.2 


Zoology * * 

CD J * 


O AC! 

3,051 


• 2 


2,373- 


.2 


Chemistry 


ol ,932 


4,7 


61,699 ' 


4.8 


Advanced Chemistry 


O ft O 1 

2,931 


,2 


3,193 


.3 


Oceanography 


9 , U40 


• 7 


7,809 


* 

.6 


Physical Science 




3,8 


47,158 


3.7 


General Science 


Q3 Q ft Q 

o3 , j9 J , 


6,3 


78,441 


6.1 


Environmental Studies * 


9 , / J I 


• 7 


. 8,947 


■0.7 


Physics 


n c ft c t 

25,957 


2,0 


26,521 


2.1 • 


Advanced Physics 


1 1*7 1 
^ 1,1/1 


• 1 


1,174 


.1 


Anatomy 


O 1 ft T 

•3,197 


•2 


3,208 


.3 


Archeology 




• 0 


1,028 * 


•V 


Conservat ion 


694 


,1 


601 


-.0 


Earth Science 


Z Z , DO J 




19,923 


1.6 


Energy Education 


222 


.0 


410 


* .0 


Geology ' ' 


2,046 


• .2 


1,446 


.1 


Life Science 


57,869 ' 




63,418 


5.0 


Meteorology 


241 


.0 


146 


.0 


Physiology 


. 18,699 


1.4 . 


16,459 ^ 


* 1.3 


Science Projects « * 


% 493 


.0 


886 


.1 


Space 'Science 


293 


' .0 


387 


.0 ' 


Science, Gifted and Talented 


6,945 


.5 


6,667 


.5 


Other Science Course 


35,856 


. 2.7 


'36,720 


2.9 


? TOTAL 


612,557 r 

1 2— » 


>46.3 


590,974 


' 46.4 



x ai\t li j.iwm vaiii.uuii,a uaoiu CtUUUau IVMiai UtiLd OyaJ-cUl VODLUO/ 

**Based on the total number of students enrolled in high school (grades 9-12) 
v 1,318,713 for 1980-81 ana 1,276,368 for 1981-82: ' 




In mathematics, there was £ decrease in the percentage of students taking 
basic, consume*, and remedial courses,. whil4 there was an increase in the 
percentage of students ^taking all other mathematics courses. The following 
mathematics courses had the greatest increases in enrollment: Computer Program- 
ing, Calculus, and Other Mathematics Courses. The following courses had the 
greatest decreases in enrollment: General Mathematics /Bas ic , Consumer 
Mathematics/Senior, Remedial Mathematics/Ma t th Ldbs, and Modern Algebra. , 
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In science, the following courses had the greatest increases in student 
enrollment: Life Science, and Other Science Courses* The following courses 
had the greatest decreases in enrollment: Biology, Advanced Biology, and 
General Science. * , 

It is^-also interesting to note that although the change in enrollment for 
Gifted and Talented Mathematics and Science cdurses from l'980-81 to 1981-82 
is minimal, there are approximately. twice as many students taking the ( 
mathematics course^ fo'r the gifted. >• 

Coursework of college-bbund students . Of special interest is t the iourse- 
work of college-bound students, who compose about' one-fourth of t;he relevant 
age population in California as well as in the United States as a whole* A 
comparison of coursework of California college-bound seniors to that of college- 
bound seniors nationwide is shown in Table 30. Unquestionably, California 
college freshmen of 19«§^ tended to have considerably less coursework than college 
freshmen nationwide f&r all core subject ,areas . In California^ 90 percent of 
1982 college-bound seniors had four or more years of English as compared to 93 
percent in the nation; in California, only 51 percent of this year p s college- 
bound seniors had four or more years of mathematics as compared to 61 percent 
in the nation; in California, 38 percent of 1982 college-bound seniors had 
three or more years of foreign langu^e as compared to 39 percent nationwide. 



Table 30 

Coursework Levels^of All Seniors and 
College-Bound Seniors, 1982 



t 


Years of study 


Percent of seniors 


4 Cal if ornia 
All' seniors* College-bound** 


Nation 
College-bound** 


> 

English — 4 or more years 
Mathematics — 4 or more years * 
Foreign language — 3 or more years 

i _ ... . , — * . „, i — 


74 90 
29 51 
19 38' 

v. 


A 

93 
61 
39 



**SAT student descriptive questionnaire data. 



On the whole, the latest year's comparison of coursework in English, 
mathematics, and fore ign ^language looks more favorable in California than it 
has in previous years (Table 31),. 

One comparison is startling: In California, only 41 percent^&f coHege- 
bound seniors report taking two or -more years of., physical scietfce as compared 
to 60 percent of college^bound seniors aationwide. If we compare coui'sework in 
physical science for the past six years, college-bound seniors in California 
have not changed;, however , nationwide, there has .been a substantial increase in 
the number of college-bound seniors with two or mote years of coursework in 
physical science. 
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Table 31 

Coursework Levels of College-Bound Seniors in 
California and the Nation, 1973-1982* 







Percettt of 


seniors 


with 


course 


level 


> 

, by year 




Years of study 


1973 


1974 


1975 . 


1976 


1977 


1978 


1979 


1980 


1981 


1982 


V 

English 

• 4 or more years 






















California 

National 

Difference 


72 
'90 
-18' 


6r 

90 
-21 


68 

89^ 

-21 


67 
88 
-21 


C Q 
DO 

89 
-21 


73 
90 
-17 


TO 

78 
91 
-12 


81 
91 
-10 


88 
92 
- 4 


90 
93 
- 3 


Mathematics 
~^Por more years 






» 
















California 
National 

* 

Difference 


35 
49 
-14 


35 
48 
-13 


34 

49 * 
-15 


JO 

51 
-15 


3/ 
50 
-13 


JO 

53 
-15 


Hi 

55 
-13 


45 
57 
-12 


47 
59 
-12 


5 1 
61 
-10 


Foteign language 
3 or more years 






















California 

National 

Difference 


40 
44 
- 4 


37 ' 
43 ' 
- 6 


34 
4i 
- 7 


33 
39 
r 6 


32 
37 
-'5 


32 
38 
- 6 


33 
37 
- 4 


34 
37 
- 3 


34 
37 
- 3 


38 
39 


Physical sci^Ace 
2 or more years 




/ 


















California 

National 

Difference 


31 
47 
-16 


36 
448 
-12 


39 

4« 


40 
50- 


37 
54 
-17 


'37 
57 
-20 


39 
58 
-19 


4ff " 
58 
-18 


40 
58 
-18 


41 
60 
-19 



*Data. taken from the reports of the Scholastic Aptitude Test (SAT) 



If coursework i^jydicatiye of achievement, then the lighter course loads 
of students in California are significant* California qollege*-bound seniors 
take significantly less coursework in mathematics and science (chemistry, 
physics , biology) than do college-bound seniors in the United States* as a whole 
(Table 32) % even though their coursework in the core academic areas substantially 
exceeds that of noncollege-bound seniors. But cour'ses taken are of concern 
beyond these particular comparisons. A major question is whether ot not a year 
and a half of foreign tangftage and two years of science are sufficient for the 
average high school graduate. < 
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Table 32 



Mean Years of Coursework in Academic Subjects for 
All Twelfth Graders and College-Bound Seniors in 
California and the Nation, 1982* \ 




English 

Mathematics 

Science 
£ t Social studies 
v ^Fp,re ign langtipge 

*CAP 4&ta\p ~* 
**SAT data.*" 



Courses taken and future plans . In conjunction with the CAP testing in the 
fall of 1981, a sample of 5,761 seniors were asked to complete a questionnaire 
about their high school career and future plans. Students were asked to specify 
which of the current University of California "A to F ff course requirements they 
had taken. A sample of the question is shown below. 



The University of California requires a series of courses known as 
"A to F" requirement .\ These courses are listed' below. Even if you 
do not intend to apply Jfor adny.ssion to the University of California , 
please indicate which^of the specific course requirements, you have 
(or will)\ comf 



1. History (One ^year) , - 

2. English (Four gears') 

3. Mathematics (Two years, 
algebra, or higher leve c l) 

4. Laboratory science (One year 
must be lab science not "basic") 

5. Foreign language (Two years) 



Any of the- following: 

'6. Math (advanced)- (One 
added year) 

7. Foreign language (One 
* added year in saipe 
'language as 5 or*tw<J 

years in another 
?ge) 

(One added year) 




It can be seen in Table 33 that the groups differ consistently across the 
various course requirements. The order of the threepublic higher education 
groups is consistent «with their entrance requirement^. The seniors planning to^ 
attend private colleges are very similar to those planning to become part of 
the' Calif ornia state college and university system, those planning work full 
time take the fewest academic courses while future community college students 
are^ only, slightly higher in academic Course taking than those anticipating 
military service. I s 
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Tkble 33 

ftrcent of Students Taking University of California Required Courses 



Required Courses 



Advanced Foreign 
Ma the- laboratory Foreign feth " language Science 
History English matics Science language (1 added (1 added (1 added-* 



Students' Fall Plans 


( 1 year) ( 4 years) (2 years) ( 1 year) 


(2 years) , 


year) 


year) 


year) 


Attend the University 
of Calf omia 


95 


98 


94 


91 


88 , 


78 


40 


71 


Attend t goe of the 
California:^ State Uni- 
versity campuses 


91 


88 


87 


82 


71 


55 


25 


52 


Attend a private 
cbllege or university 


90 


86 


82 ' 


78 . 


69 


54 


33 


53 


Attend a camunity 
college or other 2 
<rear college 


79 


70 


60 ' 


51 


39 


26 


11 


ii 


Work full time 


66^ 


50 


44 


34 


• 20 ' 


20 


7 


24 ' 


Join the military 


77 


54 


45 


'40 


Is 


28 


40 


« * 

32 


Other 


73 ' 


59 


55 ' 


'45 • 


32 


27 


12 


33 


TOTAL 


77 


69 


63 


55 


45 


35 


' 16 


37 



Homework . ■ * 

Students d6 not learn only while they are in class. They also learn out 
of school: (a) in settings, over which the school has little control — or even 
knowledge of; and (b) in performance of school-based learning tasks; e.g., 
homework/ B^ause* of its potentiality for increasing learning, homework has 
recently beetigiven considerable' attention. v 

At the sixth grade level, the assignment of homework varies considerably, 
by subject area (Table 34). Ninety-ftive percent of sixth graders report 

regular homework in mathematics^ but only .61 percent <Jo so for -writing. And 
only 66-percent of these students* report, having had homework in any subject 

' the <previous # ,day.* - 1 

' Not Reported in Table 34, is. the relationship between the Students' 
social backgrounds and the assignment of homework. The highest rates of 
homework assignment for reading, writing, and mathematics are for students 
whose parents are employed in unskilled occupations. On tjhe other, hand, 
these same student^ have the lowest, rates of homework assignments — in com- 
parison to other Occupational^ groups — for science and social studies. 
These findings are strongly consistent tfith the earlier finding of greater 
♦emphasis on reading afld less emphasis on' science and social studies in schools 
serving low socioeconomic states communities. 
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Table 34 

Homework Activity Level, by Grade 



- ^ 

Grade/subject area 


Percent 


reporting 


California 


Nat ion 


Sixth Grade* 






Usually have homework 






Reading 


82 


• 


Writing 


61 




Mathematics 


95 




Science 


63 




Social studies 


80 




Yest'erday did homework 






Any subjept 


■ 66 




Twelfth grade** 




f 


Do homework 






Any subject (%) 


, 92 


93 


Median hours per week 


^^3.0 


3.1 ; 



*CAP data, -1981-82 • 
* *High School and Beyond , 1979-80. 



Aside from direct policy issues about the amounts of time to \>k spent 
on Homework and the subject-area priorities for this time central questions 
arise about who sets these policies. CAP's sixth grade school questionnaire ~ 
probed this issue ( Ta J>l e 35). The most surprising finding is that these 
policies are either set at the district level or left to the' individual' 
teacher. The school principal — who has emerged in recent research on 'school 
effectivenesses the key Instructional leader—seemingly plays almost no role 
in homewotk policy in California. " ♦ 




Table 35 v • r 
^Origin of Homework Policies, 



California Elementary Schools, 1981-82 


Origin of policy 


Percent of schools * + 


* Teacher, not school 
£chool, not district 
District ■ 


\ 4J.8 
1.2 

56.0 % 


Total 


100.0 ^ 
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Effects of Subject-Area Time Allocations 
and Coursewark on Student Achievement " 

* ♦ . 

^Educational research literature 5 is now replete with studies linking in- 
structional time to achievement. The mere fact of such relationships is not, 
however, a true empirical finding. Logical ly, Tf instructional time is ade- 
quately defined, it must have a positive relation to learning. That is, if no 
time ( is spent, no learning is possible. On the mother hand; it is preposterous 
to allege that students never learn yhat they are* taught. Because teaching and 
learning always take time, a positive relationship is, implied between time de- 
voted to learning ancj achievement. Thus, failure to find suqh a relationship 
or finding of a negative relationship merely indicates inadequacies in the 
data or the study procedure. For research to be useful for scientific or pol- 
icy purposes, such inadequacies must be minimized so that estimates &f the 
productivity of instructional time allocations are ndt substantially biased. 

Specifically, as in the CAP study, analyses of the relationship .of in- 
structional time allocations to subject areas (sixth .graded and of coursework 
(hagh school) . to student achievement -must' reflect differences in amounts of 
ins tmctianar time, in abilities, and in performance histories among students. 
Generally, sixth graders with histories of poor performance dre in schools with 
greater emphasis on and larger time allocations to basic skills instruction. 
High^ school seniors, on the other hand, who fcake extensive coursework in a spe- 
cific area are morfc likely to have higher abilities and Histories of high 
achievement.- Thus, analyses o{ the relationships between instructional time 
and achievement for sixth graders can be expected to yield underestimates 'of 
the effects of, instruction, while those for twelfth graders can be expected to 
yield overestimates, if the relationship of student ability to instructional, 
time allocation or to coursework is overlooked.. 

Effects at the Sixth Grade Level ^ 

• ; ; — — ~.. - > \ 

This section contains a discussion, and to some degree an interpretation, 
of the relationship between instructional time and achievement. Table 36 
displays the direc'f relationship of daily instructional time in reading and 
mathematics^ to achievement indexes. The indexes* are interpretable as ^the dif- 
ferences "in percent correct achievement On the CAP reading test that result 
from one additional tfour per day of instruction in; the particular subject area. 

It can be seen that for reading the relationships are negative for all 1 
achievement areas cited; th*t is, as instructional time in reading increases, 
achievement in reading, waiting, and math decreases. The negative reading 
achievement value, (minus 5 1/2 percent per hour of additional instruction) im- 
plies that each additional hour of reading instruction is associated with a * 



*The values, are the regression coefficients for hours of instruction when these 
hours are used tp* explain ("predict") percent of items correct on the CAP 
instruments. 
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Table'36 



Achievement and Instructional Time in California Scfrools 
Change, in 'Percent Correct Associated with an Addition^} 
' Hour Rtf Day of Ins bnxot ion , 'Sixth Grade, 1981-8? . . 




Instructional* are! 


: • „ Achievement area ^ 


Written * 
Re'ading ', language Mathematics 


Reading • 
Writing/language ; 
Mathematics 
*. Science 
Social studies 

* " ■ * . 


. y~$.5 t -3.& „ ' -4.1 

•' +4.8 +4.5 '+4.3 
- +1.0 ' +1.2 V ' +2.8 
+3.7 ' +2.4 ) +1.5 
>6.4" +6 ."2 \ +4.9 

l 

« v 


* - 



I • -•■ . . . ' • . 

" drop of 5 1/2 points in percent correction reading items. For mathematics, 
*<hFVeiationship is positive. The math achievement value is 2.8,. which is 

Interpreted ,as -an' increase in "percent correct £core of 2.8^on math items for 
* each. additional hour of daily instruction in matfl. «. 



} 



Scanning the/whole table, we see systei jatic'ally negative values for . 
additional reading instruction for the thres achievement ajreas. This implies 
that California elementary schools with higi proportions 'of low achievers 
aiWte substantially" more time to reading, than, do- those whose students are,„ 
high achievers. Because of the substantial' impact of 6u*-of-school factors 
on reading, skill and because df heavy, public attention on literacy issues, 
it is not surprising that reading has .such: a high priority m -schools with 
low performance leveja. Clearly, these relationships do not represent the 
effects of instructional time on, achievement, but the "reverse- the effects of £ 
achievement on .instructional time. • . * " » . >t 

The content of the CAP tests reflects- the goals .of sixth grade' instruction 
statewide. CAP puts forth special effort to maximize this match. The goals . 
of instruction in tfce Jfcixth grade are similar , to and built upon those of ^ 
■earlier grades as well* To the extent that time allocations and instructional 
priorities in grad^six.are also, fctrongXy- reflective of, those in' the earlier 
grades, the time J learifi^elationship is reinforced, If instructional prion t 
vary -substantially over, gr^; however,- this relationship can be Seriously, 
weakened. ' t * . 

, What -is important to' 'realize * is the negative relationship of time, alloca- 
tion to reading and achievement in feeing.' •'Since reading .instruction is a, 
high priority in elementary* schools, especi^ly for low-abilify students, an 
important questipn is which subject areas should^receive low tin« allocations 
Because' of the 'high time allocations to reading^nst.ruction. S 

} ♦ ' i 
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Effects at the Twelfth Grade Level 

As discussed above, the bias in time-*achievement relations because of 
prior performance and ability amongntwelf th graders is opposite that noted in 
the sixth grade* *The matching of the instructional data and the achievement . 
data is superior, however, in grade twelve. The data on courses taken are for 
individuals, and t,hey Span the full four years of ninth through twelfth grade, 
thus strengthening and making more appropriate the links between instructional 
exposure and achievement by students 1 senior years. Unfortunately, the con- 
sent, tested in twel'fth grade does not totally reflect courses taken, especially 
advanced courses, because the content of the twelfth grade test is consistent 
with' the requirement in the Education Code that the test coyer "b^sic" mathemat- 
ics, 
i 

The relationships between courses taken and achievement for California 
twelfth graders are displayed in Table 37. These relationships are uniformly 
positive and considerably more stable than those for the sixth grade. A yfompar- 
ison of the magnitudes of the relationships with those found in sixth grade is 
problematic, however. Generally, the gain in percent corrept store per year of 
instruction is between 4 and 6 percent. Jf we assume that a typical yearly 
.course meets an hour per day, then these values are mostly higfier than those in 
the sixth grade. However, three issues obscure this comparison: 

1. The sixth grade data refer only to sixth grade, instruction, but if the 
time allocations were stable^over all elementary grades — an hour of 

# # instruction per day — the total amount of instruction would be several 

tim^s greater than the instruction accumulated bver a single year of 
high school coui;8ework. 

2. positive relationship between ability and number of courses com- 
pleted leads to expectations of much higher relationships in twelfth 
grade than sixth grade. : * . * 

3. ' The content of *the twelfth grade instrument, bqing oriented toward 

quite basic competencies in mathematics, reading, and written expres- *% 
sion, does not adequately reflect many of ^the goals of high school 

. .instruct ioni* * > ■ » " * v > 

* . \ ' 

Issue (1) wou^d tend .to augment estimated sixth grade effects in relation 
to th66e in the twelfth grade** Issue (2) augments estimated twelfth grade ef- . 
fects and diminishes those in the sixth grade. Issue (3) diminishes estimated 
twelfth grade effects in comparison "to the sixth grade estimates. Thus, the , 
first and third issues bias the result toward greater sixth grade effects, and 
the Second biaaes the result toward greater pwell^th grade effects. 
. 

High School and Beyond »fc^st information . The High School and Beyond study 
allows for comparison _of reading and math achievement of California twelfth 
graders and*£1}At'of twelfth gratiers nationwide .(Table 38)". Obviously, Cali-^ 
^ ^ 1 ^^ t ^^ t ^^ a 4§ r ( | SK c J? m ^ are favorably to twelfth graders in general. Given % 
the lower amount of sch^l^\XKtt.iLajUl9tttia students are offered, the'-data in' 
Table 38 might imply higher product ivitjr ^f^XaW'fblrnia^ schools. . * 

* ' * " " 1 - V » • 

• - ' * V ^ a. . 

*' . : ' S ~ * 
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Table 37 

Achievement Level, by Years of Coursework in Related Areas, 
Twelfth Grade/ CAP Data 1981-82 





Total 


, Percent 


correct', by number 




per- 




of years of 


coursework 






cent 
















cor- 












j or 


Vporq of coursework. bv area 


rect 


0 


1 


2 


3 


4 


more 


Mathematics 

Math course years * 

Science course years 


67.7 


54.9 
57.1 


57.2 
63.0 


62.7 
'67.4 


68.3 
73.2 


76.7 
77.1 

i 

65.6 
71.6 
65.0 


75.9 
78.5 


Reading 

English course years 

Foreign language course years 

Social studies course years 


<- 


• 47.3 
57.0 
47.1 


46.2 
60.7 
52.4 


51.4 
68.3 
60.2 


58.5 
70.6 
65.5 


67.1 
67.4 
65.6 


Spelling 

English course yeats 

Foreign language course years 

Social studies course years 


69.5 


55.6 
63.6 
57.0 


5 7. ,8 
'67.3 
62.5 


60.9 
73.6 
67.4 


65.6 
76.4 
71.1 


71.2 
77.8 
70.6 

* 


72.4 
75.0 
71.0 


Waiting 

English course ye-ars 

Foreign language course years 

Social studies course years 

— , fi, ' 


63.2 


44.3 
55.9 
46.5 


4-6.0 
.60.1 . 
5,2.2 ' 


50., 7 

68.7 

' 60.0 
» 


57.7 
72.0 
65.7 


"65.7 

h.8 

64.9 


67.6 
60.2 
6 5. '6 
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Table 38 

0 * 

Mean Reading and Mathematics Score^sof High School Seniors, 
1979-80 >' California and the^NatiQn 





Mean score,* by 


location 










Difference 


Test area * 


« California 


Nation 


in meap scores 


Reading 


4919 


' 49.fe ' 


0.3 


Mathematics 
Part I 
Part II 


50.5" • 
50.1 . 


49.6 • 
49.7* 


0*9 
0.4 



SO 



the weighted national mean is 50* and the standard deviation is 10. ^ The 
reading fce4t consists of five,, passages, each followed by four multiple 
choice questions. The mathematics tests cover basic mathematics (Part I) 
jmd more advanced high school content (Part II), primarily algebra^ 

* Source^ Special analysis of the High School and Beyond base ye*r ^ata 
/ > by -CAPT/^ ~ v. 
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m Scholastic Aptitude Test (SAT) results . Although California high school 
seniors in general compare favorably in their reading and mathematics achieve- 
ment test scores to high school seniors nationwide, concern has been voiced over 
the recent SAT scores, because the California college-bound seniors did not 
match the new, slightly upward trend of SAT scores for twelfth graders nation- 
wide (Table 39>. Some clarification on this issue is needed. The Scholastic 
Aptitude Test is taken by about one-third of high school seniors nationwide. 
Also, about one-third of high school .seniors take the SAT in. California. The 
ipath scenes of California college-bound seniors on the 1982 SAT indicated higher 
math aptitudes than those of college-bound seniors nationwide. In addition, the 
verbal aptitudes of California college-bound seniors were not discrepant from 
the verbal aptitudes of college-bound seniors across the .nation. 



Table 3^ 



Average SAT Scores of College-Bound Seniors, 
California and the Nation, 1973-1982 



SAT score 


Year 


1973 1974 


1975 


1976 


1977 


1978 


1979 


1980 


198H.1982 


Verbal 
















— r 

K 




Cali fornia 


452 450 


• 435 


430 


. 427 


427 


428 


424 


426 


425 


, Nation 


445 1444 


434 


431 


429 


429 


' 427 


424 


424 


426 


Difference 


• rr 6 


1 


-1 


-2 


-2 


1 


' " 0 


2 


-1 


Mathematics 


















Cali fornia 


485 484 


473 


470 


470 


466 


473 


472 


475 


474 


Nation * 


48,1 480 


472 


472 


470 


468 


467 


466 


466 


467 


Di f f erence 


4 4 


1 


-2 


0 


-2 


6 


6 


9 


i 



A comparison of California college-bound seniors 1 verbal scores to 
those of college-bound seniors nationwide over the past ten years, however^ 
reveals a tnuch larger score drop for California test takers. In 

California, verbal SAT scor\s dropped by 27 points; nationwide, vferbal scores! 
dropped 19 points. Tfen yeaA ago, California SAT test takers had nnjch higher 
verbal SAT scores th^n SAT tlkers 'nationally.* ■ 



California college-bourtd seniors also had higher -math SAT scores than 

the total national gr?up ottcollege-bound seniors in 1973, but their tufch 

SAT scores have dropped le/s dramatically over the past decad£ than tbUe of 
college-abound seniors nationwide* 



*If £he comparison is extended to 1972, the first year that stale-level infor- 
mation became Available, the drop is 39 and.,26 points for California and the 
nation, respectively. ,Cours'ework data were* riot available before 19 73. 
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SAT achievement test results > Beyond the verbal and math aptitude tests, 
many college-bound'high school seniors also take achievement tests in various 
subject-matter areas (TSble 40). The achievement test scores show* a more re- 
vealing picture of school learning, because they are linked more directly to 
specific course content. However, a comparison of achievement test scores of 
California college-bound high school seniors to college-bound tiigh school se- 
niors nationwide cannot merely focus on their achievement t$st. score^^-because 
relatively more students in California takeyjaa* or more of these achievement 
tests than do similar groups of students nationwide (CA, 32.2 percent; nation, 
19.9 percent). The chief reason for this is that one entrance$requirement of 
the University of California is that students take three achievement tests: ■ 
English composition, mathematics, ariH a foreign language or social sciences ^ 
area test. Thus, in contrast to the* verbal and math, apt itude. tests for whicl^ 
the California and national proportions are quite simitar, the subject-matter-^ 
specific achievement tests are taken by larger proportions of California 
students than by students nationwide. 

Achievement tests are given in English composition and literature, math- 
ematics I and II, biology, chemistry, physics, American history,, foreign lan- 
guages, and several other areas. Most California students take the tests in . 
English composition, mathematics, and American history; the latter fulfills the 
social science requirement in California. Of special interest are thpse subject 
areas in which &rfttforni^ students take fewer courses than high school students 
nationwide: mathematics^ biology, chemistry, and physics* 

Since a higher proportion of high school seniors in California take the 
SAT math achievement tests than students nationwide, their average test scores 
would be expected to be relatively bower than nationally, because the Califor- 
nia students should be a less highly selective group than math achievement test 
takers nationally. Table 41 confirms this expectation. However, if, in some 
way, the differential selectivity of test takers is adjusted for, then. the 
achievement test scores would be informative with respect to school effective- 
ness, especially in mathematics and .science, where little out-of-school learning 
occurs. 



A gross -adjustment for the differential selectivity of achievement test / 
takers can be made by accounting for .differences in aptitudes of the adhieve- / 

.ment test takers. Thg content of the^math section of the SAT is more general, 
than that of the two mathematics achiVement|tests which cover specific high 
school course content* Thus, if the SAT math scores are used 1 as an aptitude 
assessment, the relative differences between aptitude an<J achievement .scores , 
for California and the nation, would be indicative of relative differences^ 
in school' learning* Among the^aollege-bound seniors who took the mathematics \ 
achievement test in 1982, CAP. found for California students a difference oi -10 
score points (522-532) dry! for students nationwide a difference of -7 (545-552) \t 
score points^ This^rejative discrepancy of 3 score pdints between California 

"students and students nationwide might suggest that mathematics instruction in 
California has lesser outcomes than nationwide. The reason for this finding may 
be located in the lower course taking in mathematics by California Students. 
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Table 40 

Percent of SAT Takers, California and the Nation,^ 
and Total and for Selected Achievement Tests, 1982 





JPercent 


SAT takefs 




California Nation 


Percent of single-year age group 
taking SAT* 


.• - 25.4 


\ 24.3" 


Percent of, seniors taking .SAT 


33 .S* 


- 30.6 


Percent of SAT takers taking 
achievement tests: 




T 

V 


Total** 


32.2 


19.9 


Engl ish compos it ion 
Literature 


" 31.2 
1.2 


18.4* 
1.5 


• 

Mathematics I ^ 

Mathematics Ii^ , 

' - , ? 


Tf 26.0 
6.3 


14.7. 
3.8 


Biology , 
Chemistry 
Physics % 


2.0 
1.4 

0.7 ■ 


4.1 
3.5 
1.6. 


American history • 


21.1 


5.6 


Spanish 

French a 
German, 1 
s Latin 


5.9 
2.7 
0.7 
0.2 


, ■ 2.6 
2.4 
0.4 
0.3 



*These are the total ijumber of $AX takers as a percent of the 

average single-yeat age group size for individuals fourteen to 
1 seventeen years ft? ag?. ■ ° 

**TotaL percent of students taking one or more achievement tests- 



Table a; ^ 

Percent and Test Scores of SAT Takers, California 
and the Nation, by Selected Achievement Tests, 1982 



Achievement 



. Percent of 
test* takers 



Cali- . 
fornia Nation 



^Achievement 
\test scores 



Cali- 
fornix Nation 



Aptitude test scores 



Mathematics 



Verbal 



Cali- , Cali- 
fornia Nation fornia Nation 



Mathematics I 
Mathematics II 

Biology , 
Chemistry 
Physics 



26.0 

6S 



14.7 
4.1 



K0 . 4 .1 
l>x 3.5 



o.; 



1.6 



522 


545 


532 % • 


552 


479 


501 


,655 


66-1 


638 


642 


■533 ■ 


553 


541 


548 


565 


564 


524 ' 


527 


590 


575 


• 649 


. 619 


^550 


339 


614 


592 


663 


642 


537 


537 
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In the scienfc£s (biology chemistry , jihysicfs), adjustments occur in the 
opposite direction thaji for mathematics.' California college-bound seniors wh6 
take achievement tests in biologyj chemistry,' or physics are a much more highly 
selected group than students taking thesft tests nationwide. Only 2.0 percent of 
^ollege-bouiid seniprs take the biology achievement test in California as com- 
pared to 4.1 percent nationwide; 'only 1.4 percent of California college-bound 
seniors take the Achievement test in chemistry as compared to 3.5 percent 
nationwide | and only 0r7 percant of California college-bound seniors take the 
achievement test in physics as^ compared to 1.6 percent nationwide. 

The higher selectivity of California college-abound seniors taking the 
science achievement tests is obvious in their higher mathematical SAT scores. 
Performing the same adjustment^ as above f or mathemat ics , CAP found that relative, 
to students' 1 mathematical, aptitudes, the achievement of students in physicsf 
parallel^ the achievement of studetits riationwide. Not so for biology and 
especially chemistry; in both these areas, students nationwide have considerably 
•♦higher achievements relative to 'their mathematical aptitudes than in California. 
It seems important to link this result to course taking. College-bound seniors 
in California ayerage one half year less of coursework in science than their 
counterparts nationwide (see> Table 32). 
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~ Ways to Increase Student Achievement 

Basically, there are four ways to increase student achievement, the first 
three of which depend on iricreasing active learning time : 
% 

* 

1. Increase the time allocated to instruction. 

2. Increase the* proport ion of allocated instructional tilne that is 

actually devoted to instruction. 
> 

3. Increase the proportion of time devoted to instruction that students 
spend actively learning. 

4. Reduce the time needed for learning. 

Presented below are some suggestions that should be addressed in policy 
discussions related to improvement of student achievement. 



( 1 ) Increase the Time Allocated to Instruction ' * % 

• ~^ ; ; > : 

The time allocated to instruction can be increased in thr^e ways: , J 

*" * 

• Lengthening the school day and/or school year 

• Reallocating instructional time \ ' 

• Increasing homework assignments ' ^ 

Lengthening the school day and/or school year . Since California students 
are of fered cons ideraMy less schoplihg than students nationwide, lengthening 
the school day and the school year seems an appropriate strategy for increasing 
student achievement. As lqng as procedures are implemented to ensur§ that the 
additional time is used to increase the amounts of time devoted to learning 
Activities*, this method may be 'extremely effective. £uch procedures, however, 
.would have to be tjuite different in departmentalized grades — eJg., secondary 
grades—as opposed ths^self -^contained classrboms. Within departmentalized sys- 
tems, periods could be'&iited o^. leagtbened. In self-contained classrooms, care 
would have to be taken td eTt^re that the • additional time is actually used for 
instruction, the drawback to this strategy is, that lengthening' the school day 
or year requires additional .resources. — either teachers work, longer hour^' or more 
teachers are needed. » . . v 

^Reallocating instructional time * Another way to increase allocated 
learwitig time is through reallocation. In secondary schools, this Could occur 
through elimitiation< of electives or by reinstituting or expanding Required 
courses* These* actions te"stfit in reallocations from low to high priority 
learning activities and subject areas. In elementary ^choojls ,* wher$ individual 
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teachers usually plaft their own activities in self-contained classrooms, re- 
allocating instructional time implies either external control or consensus on 
priority learning areas* All available evidence points to wide and uncoordi- 
nated variations in teacher priorities, even within & single elementary school* 
Thus, inf luencing* such time allocations in elementary, schools would require 

lwide. discussion and action* One possibility would b.e to increase the de- 
gree of departmentalization in elementary schools, including lowering the grade 
levels for which.it is the ©ode of instructional organization* 
* • ^ „ 

Increasing homework assignments * Increasing homework assignments can be 
very effective in improving student achievement,,* and it as the easiest to 
implement of the three methods described* However, this method should be 
considered in relation to students' home backgrounds* Where students receive 
educational suppprt at home., homework can substantially increase their achieve- 
ments; however, where educational support from the home is lacking, homework . . 
assignments are often ineffective* *Thus, increased homewo-rk without regard to 
students' home backgrounds would tend to increase achievement for the higher 
achievers only. One way to increase achievement for all students wodld be to 
extend tVte school day by a homework period. # / * 

(2) , Increase the Proportion of Allocated Iqstryctional Time 
That is Actually Devoted to Instruction 

All' the time nominally allocated for instructional, activities is not 
actually used, for instruction. Some of this lo£s of tim£ from subject-matter v 
instruction is a result -of explicit policy — e.g., fire drills or schoolwide 
assemblies; — and some of it is irremediable — e.g., transitions between one 
class?oota activity and another* ' However, much lost„ time ^can be aVoide^t* 

Time accounting studies of elementary scfhpol classrooms haye *fouttt vari- 
ations of 50 to 90 percent' in the portion of total allocates time actually 
deyoted to, 'instruct ion* Much of the loss results from poor- management of . stu- 
dent activities: excessive transition time, between activities, poorly handled 
recesses and - breaks, 'pullout activities- that are disruptive or. that increase 
transition time, and subgroup -and seatwork activitie3 that take -too long to ^ * 
Establish* Also, in many classrooms, schedules are not met or activities in- 
volving more than on'e teacher; are poorly coordinated. All these' problems result 
in losse's of,jpreciouS instructional time in elementary schools. * * > 

Secondary schools, because of the period structure and departmentalized 
organization, are less^ prone to losses of this.etype, but issues do^arise a^>obt 
thfe length of period transitions and how related rules are enforced. More ef- 
fort devoted to identification of such problems and fortnul^tion, of appropriate 
school pbiici'ea'o'r in-$ervice training ef forts 'would be worthwhile. 

The following step^ should be considered: ' *•; 

• ^Review, pu \l out programs to deteraihe fc the. difference between allocated 
instructional, -tjLibe and. time, actually 'de^tfcd^tf^irt&ttucfEi^r' ~*' *^+r^ ^ 

v - V u - V ~ ^ * % ' r ' ■ « • 
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• Increase teachers' classroom management skills; staff development and 
in-service training should focus on man^|ment • skil Is. Teachet' training 
institutions need to put more emphasis on developing such skilly 

• Evaluate s'cho^sschedules (e.g., y ^ength of period, recess, lunch) to # 
determine how, mucH^time scheduled for instruction is lost. 

' \ ' J ' c • •*■' 

(3)~ Increase the Proportions? Time— Bevoted to * . , 

Xnstrufctioh That Students Spend Actively* Laming ! 

• • * • * . . - ? 

Jhe clearest message from the research on active learning time ("time- 
• on-task," "engaged time," "academic learning time") is that active learning r 
Is fostered by teacher-student contact and interchange. Unsupervised learning 
activities have uniformly lower levels of active learning time, ^ma 1J -group 
instruction and — to an etfen greater extent — tutorial instruct ion inc^eas^ 
students' active learning time. This increase is mos't pronounced among stu-* f 
dents who have low achievement or motivation levels, such as edVcati&naJL ly 
disadvantaged students. * « ' m ' ■ , 

' The problem with routinely implementing changes based on the above find- 
ings is one, of resources.' 1 In many classrooms, lower teacher-s tuctent j ratios* 

» could be achievejd by reducing the size of supervised instructional ^gtpups/ 
thereby increasing teachers-student contact time. In self-contained Classrooms, 

, without additional resources, there is a trade-off: When some^ students are v 
tutored or taught in small groups, others ape* necessarily unsupervised. Thus, ' 
the critical -issue — with resources, being constant — is. the trade-off Jpetween^ 

(a) large -group instruction accompanied by *little unsupervised wtfrk; , and 

(b) sfmall-group/futored instruction a'ccompanifed by considerable amounts of 
'unsupervised, student-managed activity. *\The best evidence available \ is* that 

reducing unsupervised time, even at the cost of. increasing the total J amount 
of lar|e^group instruction, is appropxiate , especially with ''students .who h§ve % 
low l£v$ls of learning motivation and self-discipline and who. are poqrly 
prepared for academic work» , I 

It *is recommended that school personnel: , ? 

• Review the .grouping strategies that are routinely used ^■elefnentary 

schools and Chat are encouraged by textbooks and wofkboore. Minimizing 
'•subgrouping, and thereby unsupervised seatwork, should be a primary 
goal, " * ' w 



• • • 

Evaluate the us$ of aide? in classrooms; using qualified aides- is an 

effective uhy to increase 'direct instruction for students. 



V 



(4) Reduce the Time Needed for teatning 

i 



Instruction can be made mote effective in many ways, which in turn jtfill* 
~* ^- -^reduce ^h^tiine , needed far learning. Two w£ys deserve ^tention: • ,., * 1 

. . ■ . • • - • ~- ' K * - : • . 
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' I. Increasing the clarity and conimunicability <xf task-related instruc- 
tions proyided by the teacher or in text materials; 

2. Iojcreasing the capabilities of teachers to diagnose students' prior 

learning, to sequence the instructional tasks, and to # keep the students 
working at a satisfying but challenging pace. 

First, clear explanations and commutation are the keys to decreasing 
the time students need to master or compme a task. This is especially true 
for students* from low socioeconomic backgrounds*. These students are especially 
affected by inappropriate arid unclear .explanations and verbal communications, 
whether they emanate from teachers , textlooks , ,or other ins fcructional materi- 
als,. The more capable students and tho/e from higher socioeconomic backgrounds 
can, >y themselves, "fill in" or substitute for incomplete or insufficiently 
communicated instruction. • t 

* Second, teachers need to cons'ider students 1 abilities and 'pr^or learning- 
in arranging learning ' tasks for th£m and estimating the* time needed for learn- 
ing 1 . The t 4 ime needed- for iearrri.ng Is unnecessarily ine#feased if teachers in- 
correctly assume specific prior -learning for -a task or if they allocate time 
'to tasks that students have already mastered." 

'\ . A . 

Staff, development, efforts should address these issues. Also, textbooks 
and workbooks should be more carefully screened and pretested with particular 
types of .students. Teachers should be taught to use diagnostic instruments 
more expensively for assessing students 1 prior learnings. At best, -improving 
teachers 1 ability to communicate is dif,fi<fult» because communication sk;ills 
are learned over 16ng. periods early jLn one'.s life* Improved teacher recruitment^ 
v and selection are the only long-term solutions^ certain to bring about significant 
improvement in .communication skills. - '* . • . 

$ It is recommended that school personnel: m - 

• Evaluate textbooks and workbooks^ for clarity ^i^strucf ioa* ^ 

*• 'Make greater use o? diagnosis. to ensure improved pacing of learning 
and challenge of students. 
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APPENDIX , 
CHARACTERISTICS OF EXEMPLARY SCHOOLS* * ' 

Exemplary schools have principals, ^ho: * - / • 
, - Create a sense of direct iota for 'the school # * * 
Execute their designated leadership role 

Foster academic expectations * >- # 

- Recruit their own staf^f , » 4 

Have more advanced training j 
Tend to have an "education as elementary school teachers 

Have particular competence in one area of • the curriculum, such as feading 
or mathematics ' 

* * » « 

Exemplary schools are-tstaffed by teachers who: 

Demonstrate proficiency in verbal skills N . \ r 

f - Have substantial educational background 

Are experienced t »' * 

-° Have achieved employment status; that is, job satisfaction arid salary 
level ' * ' s ' 

v * % • 

Have high expectations for the pupils • * 

Have better control of classes with less overt effort 

Are supported in their expectations by the principal and the parents 



Tend to use grouping procedures that emphasize small instructional groups 
for reading and mathematics but use the whole-group approach for social 
studies, science, and health '* .„ • i » 

Exemplaty Schools are composed of student^ who: 

Possess a sense of control of their own destiny ^ 

. - Believe that how well . they. \do in school depends more upon hard work than 
** 1 * ,,lipon lucfc ' * * « . « * 

Understand' from' the principal, the teachers, ana their . parents that all 
three groups have high expectations for their achievement 



*Taken from Austirf (1981), 



Exemplary, schools are schools where parents: .< 
-/ Are an integral, part of the educational process 

/ l L 

Are involved in decisions being made about their children T s future 

f . ,* 

Feel that they are real partners with school adrainistrators^and educators 
.in educating their children H 

Exemplary schools have high expectations: ♦ - ' 

for all students regardless of socioeconomic background variables , race, 
or handicap 

For all teachers regardless of their background, training, or former 
experience, 

/ * • 2* 

For all aides regardless of their background and*training 

For they^rincipal and for other administrators of the school 

/ 1 ' 

For ail spaff people associated with the school, including office staff, 

kitchen staf f , janitorial Staff , and others. 

Organisationally, exemplary schools: 

Tend to have a high degree of articulation, particularly in reading and 
mathematics • /, 

Base inservice stafJE development programs on needs identified' by the 
school staff, not by the central office «' x 

Give very high priority to £ime in the school day for instructional 
activities , 

Instructional practices in exemj)l$,ry Schools: 

Require that academic objectives be clearly identified and stated 

Tend to use small-rgroup ancf individualized instruction for mathematics an 
reading; whole-group instruction for other curriculum areas, 

Encourage direct instruction by the teacher 

Consider prior learning and learning styles, of the students 



VIII. Computers in California Elementary Schools 

Synopsis of Findings 

• Twenty-nine percent of the elementary schools in California hav^sa 
terminal or microcomputer. • t 

• % 0he-half of the elementary schools with a terminal or microcomputer 

indicated that students spent less than 15 minutes daily at a terminal. 

4 Eighty-three percent of schools with computers use them for computer- 
assisted instruction. 5 \ 

• Content areas most often studied with the computer were mathematics, 
vocabulary/spelling, language, and reading. 

• .Eighteen percent of sixth grade students indicated that th£y had a 

computer at home'. T 

• Forty-five percent,of the students indicated that they fyad a video game 
at hoije. - _ . , 

• Twenty-four percent of the students indicated that they played elec- 
tronic games away from home several titnes a week. 1 ■ 

• Seventy-eight pfercerit of the students indicated that they never have 
used a computer in school. 

• * i *** 

t A statewide survey of computer use in schools and of student experiences 
with computers was conducted during the spring, 1982, administration of" the 
California Assessment Program's Survey of Basic Skills: Grade 6 . The 
primary goal of the computer survey was to obtain preliminary data on stu-r 
dent and school access to computer equipment and the educational applications 
of this equipment. A further goal was to relate achievement and socio- 
economic status ta'different school^applications and different degrees of 
student experience. Public schoal use pf computers has been of recent 
interest. The results of a survey conducted for the National Center for 
Education Statistics in April of 1982 showed that the number e of personal* 
computers u?ed in schools for instructional purposes tripled' "between the 
fall of 198D and the sprang of 1982. Thifty-f iva' percent of the public 
schools nationwide had jSotaputers, available for -instruction in jthe 1981-1982 
school year. Ttfe results reported here are a mote detailed examination of 
Computer use* in California. » 



* • Study Design : . «• 1 

•t * . • 

Survey Questions . The survey 'of ' school principals addressed the issues of 
access to equipment, staff dfetfelopment, and types ofusei The questions 
were: ' , *' 

1. Do you have a computer terminal "(or microcomputer such, as APPLE or 

. TRS80).in your school? (yes, no) The remaining questions were answered 
% ' by those who said yes. ■ 
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2 ' Hoi many computer* terminals or microcomputers are .there in your school? 
(£-2 r 3-5, 6-10,'; 11-20, more than 20) 

W * * 

3. 'where are your terminals lo.cated? (in the computer media room, in 
individual classrooms, other) 

Indicate in which of the " following ways the computer is. used, in your 
school* .. ' *• y 

a. Computer assisted instruction - involving direct student and marine 
interaction 



4. 



, ft: 



b. 

c. 
d. 



Computer managed 'instruction - test scoring, maintaining pupil progifi^ 



records, etc. 

4 

Administration - scheduling, etc. 

Computer 'literacy and education - for students . or teachers 



f. 



5 What proportion of your teachers have participated in any; workshops or 
•* • T£r starf development oppportunities focusing on computer literacy or ,].. 
' the role of computers in education? (all, most, -some, a, few, none;. 

6. Indicate the subject ai»eas which are studied on the computer. 



r 



a. 


Reading 


b. 


Voca^ilary /spelling 


c. 


Language 


d. 


Science 


e. » 


Math drill : 


f; 


Mathematics problem solving 


8« 


Music 


h. 


Foreign language ^ 


i. 


Health- 


: i« 


Simulation' $nd games 


k. 


Programming' 


1. 


Creative applications 


m. 


Other 



7 About how many sixth grade students participate in. instructional ' 

• ? * trogralTuaing computers? '(all students; about three-fourths, about 

O one-half, about one-fourth; less than one-fourth) 
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8. On a typical^ay, how njuch time does a sixth grade student spend at the 
terminal? tfess than 15 minutes, about 15 minutes, about 1/2 hour, 

« % dbqut 1 hour, more than 1 hour) 

9. During a typical week, how many times* does a-sixth-grade student use a 
terminal? (once, twice, tfiree times, four times, five times or more) 

The student survey addressed the availability arid use of. equipment at 
home and away from home. The questions were: 

1: Do /you have a computer at home? (yes, no) . < 

2. How often do you use a' computer -in school? (never, once a month, 
once a weeK, several times a week, every day) « . * 

3. Do you have.an electronic TV game (like. Atari) at Home? (yes, 
no) 

K . " • ' 

4. How often do you pla^ electronic games (like Atari) away from home? 
(never, once-^a month,- -dttce a week, several times a week, every day', 
seVeral-^t imes a day) 

School Sample . A one-fourth systematic sample of schools was drawn for 
use with the survey of school principals. The school principal, or other 
person certifying correct administration of the CAP testy responded to the^ 
sutvey. The data were received from all 987 schools that deceived this 
survey. * 



t 



gtudertt Sample . Sixth graders were systematically selected to respond 
to the student survey.. Questions were included on several Of the 40 unique' 
forms, of th<? sixth grade test, which were spiraled for distribution to 
-ensure random* assignment of forms to students and equal numbers of 
students taking each form. The two questions, "Do yoi**have a computer, at 
home?," and "Do you have an electronic 1 TV game (like Atari) at home?," were 
included together on three forms and responded to by 21,908. students. The 
question, "How often do you us'e a computer in school?,", was included oh 
three different forms' and responded to by 21,880 students. Filially, the 
question, "How often do you play electronic games (likeAtari) away from 
home?," was placed on four other forms and was responded to by 29,311 
students. Less thah' 3 percent nonresponse was obtained for all questions. 

Analyses . The 'analysis ofthe survey of school principals commenced 
with the regression of mean school percent correct achievement on a measure 
,of socioeconomic status. The measure of socioeconomic status was based on 
teacher ratings of parent occupation. Occupational categories were profes-% 
$ional, semiprofessional, skilled, 'and unskilled. Separate regressions were 
performed for reading; written language, and mathematics. Residuals were 
calculated for each Qontent area. These were scaled to have a >mean of 50 
and a standard deviation of 15 for convenience in displaying the repults. 
School achievement rasidual scores and the measure of socioeconomic "status 
were broken down on The basis of 'responses to the questions. Student 
percent correct scopes were broken down on, the basis of responses to ques- 
tions and on student socioeconomic status. / q » 
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^/Results* 

, ♦ 

Access to Equipment . f 



/ 

/ 



The- resets for the question, "Do 'you have a computer' terminal/ (or micro- 
computer such as APPLE or TkS80) in ypur school?, 1 are shown in Table 42. 
. Twenty-nine percent of the sample schools indicated that they possessed this 
•e^uipLn-f: These spools tended to have highef average student ,< 
.statu's. The remaining questions in the survey Were responded to by the 287 
Schools with computer equipment. 

The results for the question; "How many. computer terminals or microcomputers 
* are these in your schodl?," are shown. in Table 43. Forty-one percent indicated 
one 16 percent indicated two, 30 percent indicated three to five, 9 percent 
indicated six to ten, 4 percent indicated 11 to 20, and i percent indicated more 
than 20. «, * , • 

The results for the questipn, "Where are your terminals located?,", are 
■ shown .in Table 44. The equipment was located .in the compute^ »ed« ^op» for 
' 36 percent, in classrooms for 46 percent, and elsewhere for 28 percent of 
' the schoo Is. These parents sum, to more than 100 because schools could indicate 

Ire than one location. Schools with classroom locations tended to have higher 

average student socioeconomic status. * 

Applications in education " ^ 0 *v ^ 

The results for the question, "On a typical day, how much ti^ does a . 
sixth grade student spend at the terminal?," are- shown u Figure 34. The 
Scents corresponding, to each option were as W £ "ercTt ' 

' 48 percent;' about 15 minutes, 28 percent; about one half hour, 22 percent, 

L about one hour, 2 percent.- No schools indicated that their students , 

' jspent over one hour per day on the computer. > ; 

Responses to the item, "indicate in which of the following ways the 
compute 'is usee in your school" are shown in-Sable 45 The equipment was 
-used or computer-assisted instruction by 83 percent of the schools for 
computer-managed instruction by 19 percent of the schools, 

Hon bv 14 percent of the schools, and for computer literacy 'education by 51 
percent of the schools. Again, , percents^um to over 100 because more than 
one use could be marked by a school. 

' The responses to the qu'estion, "Which subjects are studied on the 
' computer?" are shown in Table 46. . Those content areas with the highest 
computer, a percent; math problem solving 49- percent; 

l T e \llL and tile? ^'percent vocabulary/spelling, 38 percent; program- 
simulation and ga mes ^.P e J ' fent; ^ nd reading , 33 percent. Relatively • 

IS 

as tnose already listed. These .other content areas were science, 13 percent* 
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- 'j • • ' ' 

and creative^applications, 22 percent. Generally, higher socioeconomic 'status 

was associaCed with higher achievement. / v f 

* ' ' * ( 

The results for* the question, "What ' proportion of v ybur teachewrs have i 

participate-in any workshops or staff development?" are shown in Figure 35. 

Although 287 ^schools said they had computer equipment, 331 school^ responded 

,to this question. The percents responding to each, option were as follows: 

all, 15 percent; most, 14^percent; sonje, 22 percent; 'a few-, 40 percent; and 

nqne r 8 percent. Achievement tended £o be higher in those schools with more 

staff development. Mathematics aehie/Vement i.s higher fpr those schools 

responding "all" than for those responding "most." Average socioeconomic 4 ' 

status was highest for" those schools/ that indicated that most of their 

teachers had st#ff development trairting and was fewest for those school's 

that indicated a few teachers had Siich training. * t * ^ J 



Student exposure 



The results for the question/, "Do you have a computer at hotye?, 11 are 
displayed in Table 47. Eighteen /percent * of ,the^ students said yes, which *^ 
included a hig&e^ proportion of ^ooys than girls. Larger percentages of 
students of hj»er socioeconomic status than lower socioeebnomiefstatus 
reported having, a computer at Nome. Achievement wasnearly the same for 
both "fcroups^of. students! */ % 

The results for the question. "Do yoti have an electronic TV. game (like 4 ^ 
Atari) at home?, n are shown in Table 48. Forty-fftve percent 6f the students 
s.aid yes. Larger proportions of boys ft than girls, reported having such gaiqes^ 
More than half the students^ in each of the two upper, socioeconomic' status 
groups said yes, compared to less than half of the students from, the lower <4 
two # socioeconomic status groups. Achievement scores were higher for those 1 
who said yes than for those' who said no: in reading, 70.4 percent correct 
compared to«65.4 percent correct; in written language, 74 • 1 percent compared 
'to 70.7 percent correct; and in 'mathematics , 64.7 percent correct compared 
to 59.3. ^ + ' ^ 

* *" . 

A plot Y pf. achievement results broken* down by socioeconomic status / 
is^shown in Figure 36. Totafpercent correct achievement is plotted* The v 
largest* difference in achievement shown for students in Ithe "unskilled 11 
category. % Students from the "professional" 1 category had the smallest' 
difference in achievement. It is very unlikely that the presence ( of a 
home video game is responsible for highet achievement;. A plausible alterna- V 
tive is that access to such games is part of a home environment where 4 
parents desire to provide intellectually stimulating activities for their 
chiTdren.. Such parental influence, making itself felt in many ways/ 
might well be the c^aus6 of higher achievement. 
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* * 

The results for the question^ M How often do you 'use a computer in 
school?/ 1 are displayed in Table 49. The, portents of x students responding 1 to 
each option were as follows: never, 78 percent; once a* month, 7 percent; 
once a week, 6 percent; several times a week, 4 percent; and eVeryday, 2* 
percent. Roughly equivalent proportions of boys and, girls indicated each* t> 
response. "Slightly smaller percentages of students in 'the "professional" t 
category re^rted never using^a computer in school compared to students in 
other socioeconomic status groups. .Higher proportions of students in the 
twtf upper socioeconomic status groups, compared to those in the two lower 
groups, reported .using a computer once a month or once a week. For more 
freq'uent use, the percentages of students from all socioeconomic groups <if£ 

'roughly the same. , A 

• ^* \ * » 

< < \ * * 

The results for ttje question, "How often do you play electronic gamefe 
away .from home?," aire sW in Table, 50. The percents of students reponding* . 
to'each option were as follows: never, 18 percent; once a month, 22 percent;*, 
onte a week, 21. percent; several times a week, 24 percent;' every day, 7 / 
percent; several times a day, 6 percent. .Highef percentages of boys reported 

'playing, more* frequently, and higher proportions of girls reported playing 
less frequently. A plot of achievement results broken cfown by socioeconomic 

.status is shown in Figure 37. . Highe,r frequencies o'f playingyele^tronic games 
aw&y fronr home are associated/with lower achievement for all socioeconomic * 
Status groups. Students who report never playing such games have slightly lower 
achievement than those who report playing cmce a mcmth. No claim is made that 
playing video games away from home .is responsible for low«^achi£V£inan^ a 
^p-tauslfrl^^Hernetive is that a lack 'of positive influences in the home 
ment' could' both discourage academic success and encourage playing away from 



A 

environ- 
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Resting for the Ques.tiop, 
"Do You Have a Computer Terminal' (or microcomputer 
such as APPLE or* TRS80) in Your School?" 



Response • 


i 

' Couint 


Percent 


Socioeconomic 
Status 


Yes 






2.20 


No 


/ 700 




' 1.99 






.I \ 

Table 43 


i 



Results for Responses to the Question, 
"How Many Computer Ter-minals or Microcomputers 
are There in Your School?" 









Socioeconomic 


Response - 


Count 


* » ' Percent 


Status 


* 

i 


113 

• 


41 


2.18 


2. 1 


45 




•2.16 ' • ' 


~~*-3=5' - 


87 


* 

30 ~"" 


,«•*•«* • 

2.21 


6-10 


« \ 

. 25 

i 


' 9 


2.28 ' _ 


. 11-20, 

< 


' 12 


4 ' " 

i 


2.21 r 


i » 

Greater than. 20 


3 1 


% 

1 


1.81 

r 


■ u & , 






^ 
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Results for Responses 1 ; -to, the Question, 
""^ k ere Are Your Terminals Located?" 



1 

Response 


Count 


Percent 


Socioec6nomic 
Status 


Computer 
media room 


10*4 


36 ' 


* 4 * 

2.19 


Classrooms 


% 
133 




2.23 


Othfer 




28 .v 


I %.15 , 
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'Results for the Item, 
'Indicate in Which of the Following Ways the Computer is 
Used in Your School?" 



Response^ 


Count 


Percent 


Soc ioeconomic 
Status 


Computer- 
assisted 1 
instruction 


239, 


83 


2.19 - 


Computer- 
managed 
instruction 


' 55 . 


< 

• .19 


2.06 


Administration 


1 40 


14 


2.15 , • 


Computer . 
literacy 


146 


51 


2.32 



/ : ; 

' -liable 46 

Results for Responses to the. Question, ' 
'Which Subjects .Are Stuiied on the Computer?" 



Response 


Count 


Percent 


Reading 


Writing 


.Math 


Socioeconomic 
Status 


Reading t 


97 


33' , 


48.71 


. 48.44 


48.26 


2.08 

i 


Vocabulary 
' spelling 

language > 

Science - 

Math drill 


108 
.98 
36 
174 

< 


t 

38 
34 
Of 

" 61 


49.70. 
51.31 
'55.31 
51.52 


49.78,, 
51.38 
55.25 
50.80 


49.56 
52.13 
56.67 
51.51 , 


,2.12 
2.13 
2.63 
2.16 


Math problem 
solving 

Music 


• 128 

; \ 


49 

. • 1 


.52.61 
" J 55.40 

54.12. 
58.78. • 


' 52.53; 
57.68' 


52.94 
58. 16 


~*> ♦ 
^2.18 « 
' 2.38 t 


Foreign 
vj^mguage . 

Health 


2 


1 ... 
1 • 


54.23 
60.35 


55.91 
56.62 


2.00 
2.04 


Simulation and 
g^mes 

Programming 


124 
103 


» 

43 

/ 36 


54.42 
55.04 


53.52 
53.91 


54.37 
55.42 


2.28 
2.35 


Creative * < 
applications 


P 62 


' 22 


55.16 


53'.'09 


54.71 


2.40 
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Table 47 



Results for t>ne Question, 
"Do You Have a Computer at> Home?" 











Percent of 


Sample 


-4. 






Percent correct score 


Response 


Overall 


Boys 


* 

Girls 


Professional 


Semi- 
Professional 


Skilled 


— : *— 

Unskilled 




Reading 


Written 
Language 


Math 


Yes 


18 


21 , 


15 


* 21 . ' 


19 


18 


' 14 




67.5 


71.8 * 


61 U 


No 


' 79 


. 77 


• 82 


* 


79 .* 


: 79 


84 




67.7 


72.4 „ 


61.8 


No response 


3 


2 


3- 


2< 


1 


3 


2^" 




60.3 

1 


64.. 9 ' 


54 v l 



Table 48 , T 

Results for th,e Question, * 
"Do /ou Have an Electronic T.V G^me (like. Atari) at Home?" 











Percent of 


Sample 








Percent correct score 


Response.., _ 


Overall 


Boys 


Girls 


Professional 


Semi- 
Professional 


Skilled 


Unskilled 




Reading 


Written 
Language 


Math 


Yes 


45 


53 


37 


< 56' 


• 52 K 


46 


29 




70.4 


74 ( a 


64»7' 


No ' * 
No response 


2 

i 


45 

2 . 


* 61 

2 " 


43 

< i 


46, 
2 


52. 
2 


68 

3 




' 65.4 
' 57.8 ' 


• * 

70.7 
62.8 


59.3 
51.7 



Computers ih California Element'ary Schools 
+ >K . . Table 49 ■ ' 



» * • Results for the Question, 

c * - "How Often* j)o You Use a .Computer in School?" 

4 _ 



Response 



Never 

Once a month 

Once a 'week 

Several times 
a< week 

Ev^ry day • 
♦ 

No response 



Overall 



78 
6 

4 ■ 



.Boys Girls 



77 
7 
6 

5 

2- 
3 



80' 

• .7 

" - 3" 
3 



Percenp.of Sample 



t 



.Semi* • 

Prof es s i ? onal Pro fessional Skilled Unskilled 



if 

id 

.7 



5 
1 

'•- 3 



79" 
9 



r 
i 

2-* 



80 
6 

, 5 

2 
3 



•80 
6 

.5 



5 " 

2'/. 

2 



, Percent correct score 



Reading 



71.5 
74.7 1 
72.2 

69.6 

♦ r * 

.65.7 



Written 
Language 



74.1 
75.9 
74 ;7 

, « 

72.4 
65.6 
67 r .6 



Math 



62.4 
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Table 50 

Results for the Question, 
"How Often do You Play Electronic Games Away From Home?" 
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f Fjg. 34, Responses to question, "On a typical day, how much time does a sixth grade student spend, at the 

* terminal?" by subject area 
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Fig. 36. Studenv.espojises to question, '.'Do you have an electronic TV game at home?" by total achieve- 
, ment and parents' socioeconomic status . •» • 
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Fig. 37. Student responses to question, "How often Uo you play electronic games away from home?" by 
total achievement and parents' socioeconomic status 
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% Appendi* A * ' 
W Assessment Advisory Committees . 

r . * 

'Listed below are the members of the Reading 'Assessment Advisory Committee, 
English language A^essine^t A^yjUorjt Committee, and the Mathematics Assessment 
Advisory Committee, who were instrumental in the review and analysis of the 
1981-82 findings. ' , ' 



Reading Assessment Advisory Committee 



Espy Acuna, Central Union 'Hi-gh^' School Bi*t£i*it ' _ 

Cathy Beediay -Saar Marino Unified Schools-District - — ~_ _ ~ J_ 

Sandy Biren, San Juan Unified School District ~ 

Ashley Bishop, California State University, Fullerton ~~~~ 

Lois B^aun, ISanta Monica-Malibu Unified SchboT District 

Jacqueline Chaparro, Office of ttte, San Diego -Cpunty Superintendent *of 

Schools * 

Pat Ends ley, -Berkeley Unified School District ' \ ' 

.Harry Ford; • Covina Valley Unified School District j. 
Dorothy Grier, Chino Unified School District * rT f 
Ruth Hartley/ California "State University, Sjjcr$m6nto % j , 
Cecilia Hill, Los Angeles Unified School'Dis trict ' ^ 

Jacqueline Hodge, West Fr&sno Elementary- School.vDistrict 
,Jack Jones, California Polytechnic State University, San Luis Obispo 
Joyce Krutop, National Elementary School District / 
Heath Lowry, University of the Pacific 

Robert Lowry, Alum Rock Elementary School District / ' * j 

John Malkasian, Sacramento City Unified School District / . • 

Beverly. Maple, San Juan Unif iedSctiool District ' * /. : \ 1 

Donavan Merck, State Department of- Education J 

Janice Meyer, Office of, the Santa Barbara County Superintendent of Schools 
Deborah Osen Hancock, California State College, Bdkexsf ield 
Alptra Quincy^ Mt. Diablo Unified School District ■ ' 
Grayce Ransom, University of Southern California ' 
Marie Santojs, Depair. Unif ied -School District * 

Marian Schilling, Office of the Los Angeles County Superintendent of 

Schools c < < ' 

Pam Shilling, Corona-Norco Unified School District 

Alice Scofield, San Jose State University /.' 

JOellyh Taylor, Far West Regional Laboratory 1 

Myrna Tsukamoto, San Francisco Unified School District 

Barbara Valdez; North Sacramento Elementary School District 

John Walters, Office df the* San Diego County Superintendent of Schools 

Beth Breneman, State Department of Education Consultant to. the Committee 



English Language Assessment Adviso'ry Committee . 

Diana Adams, Lakeside Unified School District 

Sheila Anchondo, San Bernardino City Unified School District 

Robert Beck, John Swett Unified School District ^ 

Stephen Black, Oakland Unified School District 

Judy Carlton, Hacienda La Puente Unified School 'District 

Muriel Dillard, Office of the Kern County Superintendent of Schools 

Bonnie Garner, El Monte Elementary School District 

Kent Gill, Davis Joint Unified School District 

Rifchard Giovannoli, Biggs Unified School District 

Bernard Goodmanson, Los Angeles Unified School District . 
Julia Cottesman, Office^of the Los Angeles County Superintendent of Schools 
Jim G* ay, University of * Calif ornia, Berkeley 
Louise Grindstaff, California State University, Northridge 
Wayne Harsh, University of California, Davis 1 
Everett I. Jones, University of California, Los^ Angeles 
Helen Lodge, Calif drrtia v State University, Northridge 
Marguerite May, Los Afrgeles Unified School District 
Joanna Mckenzie, California State University, Northridge 
Pat Moore-HovaYd, Sacramento City" Unified School District 
-Jim Musante, Moraga Elementary School, District 
George Nemetz, State Department of Education 
Rocky flrtega, Oxn^rd Union High School District 
Dale Oscarson, ^Palo Alto City Unified School District ' 
Alice Scafield, San Ja$e .State University 

Linda Short, Los Angeles Unified School District • * 

Barbara Tomlinson", University of California, San Diego, r 
Ross Winterowd, University of Southern California 
Bill Wise, San Tu an Unified School District. - ^ 
Joanne Yee, Gold Oak UniStf- Elementary School District 

Beth Breneman, State Department of. Education Consultant to the Committee 

- ■ ' - ' : v # ' . ' 

Mathematics As sessment Advisory Committer 
■= ~ ; J - » • 



\ 



Charles A^te^rtatf' Angeles Uqif ie4^chool DistHct , / 
Joan Akeri, Santee Elementary Ucfiool District ' ' 

Marguerite Brydegaard, San Diego 'State University 

Joe Cooney, Office bf the San Mateo County Superintendent of Sdhools 
Clyde Corcoran-, Whittier Union High School District 
Richard Dean, California' Institute of Technology 
Sistef Rope Eleanor Ehret, Holy Name^ College 
Lyle Fisher, 'Taraalpais Union High School District 
♦'Ruth Hadley, Lompoc Unified School District . * 
Joseph Hoffmann, State Department of Education 
Thomas 'Lester, San Juan Unified School District 
GaU Lowe, Conejo Valley Unified School District 
Sandy Masshally University of California, Sahta Barbara 
IVance Mills, Jten Diego .City Unified. Schpol District 
Susan A. Os^ergard, University of California, Davis 
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Holland Payne, Sacramento City Unified School District 

Henry Palmer, Office of the Los Angeles County Superintendent of Schools 
Ruth Kiley,- Fresno Unified School District 
Linda Silvey r Los- Angeles, Unified School District 
Jean Stenmark, Oakland Unified School District 
Harold Taylor, San Mateo Urfion High School District 
Shirley 'Tfembley, Baker^fie Id College 

Tej Pandey, State Department of Education .Consultant to the Committee 
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